You are on page 1of 211

Violation Date Total Violations 7/15/2013 7/16/2013 7/17/2013 7/18/2013 7/19/2013 7/22/2013 7/23/2013 7/24/2013 7/25/2013 7/26/2013 7/29/2013

Brekford Processing 103 112 191 199 73 210 180 75 200 0 0 1343 7 7 5 17 8 10 58 7 171 0 0 290

Brekford Accepted 59 87 136 147 58 165 91 57 0 0 0 800

Brekford Cancels 33 17 48 35 8 34 27 10 1 0 0 213

Client Processing 0 0 0 0 0 0 0 0 0 0 0 0

Client Accepted 59 87 135 137 53 159 2 0 0 0 0 632

Client Rejected 0 0 0 9 4 5 1 0 0 0 0 19

Print Queue 1 0 0 5 0 0 2 0 0 0 0 8

Printed 58 87 135 132 53 159 0 0 0 0 0 624

Processing Status

250

200

Violations

Client Rejected 150 Print Queue Brekford Processing 100 Total Violations Brekford Accepted Client Accepted Printed Brekford Cancels Brekford Processing Print Queue Client Rejected Brekford Cancels Printed Client Accepted Brekford Accepted Total Violations 50

Automated Traffic Violation Enforcement System (ATVES) Summary Status Report on ATVES Program Test Run July 15, 2013 through August 15, 2013
Draft Report August 16, 2013

Introduction
The purpose of this Status Report is to provide a summary of the observations and performance metrics recorded for the ATVES Program Test Run to date. URS (assisted by subconsultant RJM) have been conducting observations at the Brekford Processing Center and tracking performance metrics since July 15, 2013 as part of Baltimore City Department of Transportation's (DOT) effort to document quality control efforts during the test program re-initiation process. URS has conducted the following tasks, to the extent the data provided would allow, as requested by DOT: 1. 2. 3. 4. Review of Standard Operating Procedures (SOPs). Oversee the Brekford operations and make sure they are following their SOPs. Monitor the processing rate of Brekford analysts. Review a percentage (at this time 25%) of violations before they go to Baltimore Police Department (BPD) to ensure they are violations. Discuss concerns on site with Brekford. Keep a record of all violations that URS canceled and justification for cancellation. Track processing related metrics. Review additional citations in iP360 software after they are mailed to DOT, for quality assurance. Prepare a report on the 2 Portable Camera Units (PCUs) on the sensor height difference, new firmware, and (BPD) field speed test. Perform field visits to check on camera setup periodically. Ensure that Brekford is properly documenting and communicating all of their maintenance work on the PCUs with DOT (see SOP).

5. 6. 7. 8. 9.

Summary of Observations and Performance Metrics


The following is a summary of our observations while at the Brekford Processing Center and a review of available and quantifiable system performance between July 15th and August 15th. This information is intended to provide DOT with an understanding of the areas of concern that have been observed and are documented along with an explanation from Brekford of how the issues have been or will be addressed.

1.

Review of SOPs

URS only had access to Draft versions of the SOPs at the time of the Test Run. URS focused on reviewing the following SOPs: Brekford Quality Assurance Plan, July 9th, 2013 Brekford Processing Citations for Speed and Red Light Violations Standard Operating Procedures, June 12, 2013 Brekford Operations and Maintenance Standard Operating Procedures, July 25, 2013 Brekford & BPD Daily Set-up Log Verification Standard Operating Procedures, June 12, 2013

Final Versions of the SOPs were provided by DOT on Wednesday, August 14. URS will review these final versions, and monitor Brekfords adherence to their guidelines and requirements. URS is waiting for the finalized version of the DOT/Brekford Business Rules agreement. 2. Oversee the Brekford operations and make sure they are following their SOPs

URS and RJM employees have been present in Brekfords Processing Center almost every day since July 15th in order to better learn the processing system from the Brekford processing staff, review citations, summarize performance metrics, observe and ensure SOP adherence, and report any concerns with the system equipment and processes in place. URS faced challenges in making sure Brekford was following their SOPs due to the following reasons: URS did not have finalized versions of the SOPs to work from until August 14th, and are still waiting for the finalized Business Rules. URS did use the draft versions of the SOPs in the meantime and was able to track the process to the extent possible, however concerns were voiced that the final versions may change drastically, and might affect this process. On several occasions, URS was not provided with citations to review in the DOT consultant review queue. Brekford has acknowledged a potential issue with a program script and they are working on a fix. URS was initially granted access to iCam to review Daily Operator Logs. However, this access was revoked as of July 19th, and not provided again until after DOT instructed that access be reinstated, it was provided on August 7th. o BPD has had issues with the daily closeout logs not operating correctly, resulting in Brekford dismissing several days worth of violations (in accordance with the business rules). URS has requested access to the violations canceled by Brekford Processing Staff several times, this request has gone unfulfilled to date. However, Brekford has stated that they
2

are working on addressing this issue. URS and DOT need access to the canceled violations in order to determine how efficiently and accurately the processors are working. URS has not been provided any monthly QA reports, which are to be produced as stated in the SOP. URS has not been provided any copies or access to electronic versions of the Asset Management Logs (this may be due to the fact that only one camera is currently operational). URS has not had access to the iTicket page, and cannot verify if the issues log is functional and/or being used appropriately in accordance with the SOP. URS has not been provided copies or access to the Quality Analyst Transaction Processing Agent (TPA) Logs, and cannot verify if they are being completed in accordance with the SOP. This, again, may be because there is only one location operational, but these documents should be provided for review. URS has noticed that the processors do not have hard copies of the Site Books to use as a guide when conducting their reviews; however, they do have access to electronic versions at their workstations that they can toggle to when needed. Monitor the processing rate of Brekford analysts

3.

As of Thursday, August 15, 2013 Brekford has received a total of 2,949 violation events. So far 2,630 of these violation events have been processed by Brekford staff. The 319 additional violations remain marked for processing. Brekford has accepted 1,633 violations (a rate of roughly 55%) and canceled 997 (rate of 34%). Of the 1,633 accepted violations, BPD has rejected 52 violations (a rate of 3%). Of the 2,630 Violations reviewed, 1,581 were accepted as viable citations by Brekford and BPD (rate of 60%). Review a percentage (at this time 25%) of violations before they go to BPD to ensure they are violations. Discuss Concerns on site with Brekford. Keep a record of all violations that URS canceled and justification for cancellations.

4.

URS has reviewed, when available, a queue of approximately 25% of the violations accepted by Brekford Processors. The URS DOT Consultant queue contains anywhere from 40 to 120 citations to review. Although, as noted above, there have been several days when no citations have been provided. (This is being addressed by Brekford.) URS citation review has resulted in a few notes, as follows: It appeared on several violation events that the yellow reference lines were not lining up with the field established roadway markings. It also appeared that the lines would move
3

between different days. Brekford investigated and determined that the camera was moving on its mounting and would need to be stabilized. URS noted that it appeared as if the .pdf version of the citation could be modified in iP360. DOT stated that the .pdf must be in a format that cannot be changed. Brekford noted that while it appears the .pdf can be modified, it cannot be saved with any changes. URS reviewed a few citations that appeared too dark or had clarity of plate issues. URS discussed these with Brekford and the citations were either rejected, or Brekford provided a reasonable explanation for why they should be accepted. URS noted that a few citations appeared to have early triggers (i.e., the vehicle was positioned prior to the reference line). Brekford reviewed these and agreed they should have been canceled, and processors were re-trained to look for these issues, inform supervisors of the problem, and cancel the citations accordingly. URS noted that some images have people visible and suggested that measures be taken to ensure faces/identifiable features are blurred. Brekford and DOT are working with the City Legal Department on issues and potential solutions (if needed). Additional issues, along with DOT and Brekford responses, have been documented in emails and are provided in Appendix A, below. Track processing related metrics

5.

URS has been tracking both Key Performance Metrics and all available data provided by Brekford on the processing, acceptance, and rejection rates. URS will provide updates every Monday on the previous week's performance rates. 6. Review additional citations in iP360 after they are mailed to DOT, for quality assurance.

URS has not been provided any citations in iP360 after they have been mailed to DOT for quality assurance. DOT may be conducting this review in-house at this time, and URS will assist as more cameras are activated. 7. Prepare a report on the 2 PCUs on the sensor height difference, new firmware, and BPD field speed test.

URS and Brekford spent a few weeks coordinating the data format needs for the analysis and documentation efforts for the equipment height report. As of August 7th, URS has the data in a functional format for the analysis, and the statistical evaluations are underway. URS also has the summary reports for the firmware modifications and the results of the BPD field speed test. URS will notify DOT if any additional issues or concerns develop during the analysis.

8.

Perform field visits to check on camera setup periodically.

URS has conducted several field visits to the site of the test run equipment. The cameras have been set at the two different heights as instructed by DOT. URS has provided an Engineering Site Assessment report for the test site location LC 2054. This report concludes that there are no geometric or safety issues related to the location of the cameras, and that the cameras are properly signed in accordance with MdMUTCD requirements. URS staff believes that the cameras at this site meet SHA guidelines for installation within a school area and school zone, providing a potential safety enhancement for school activities. 9. Ensure that Brekford is properly documenting and communicating all of their maintenance work on the PCUs with DOT (see SOP).

URS has not been provided any documentation on maintenance work on the PCUs. URS does not have access to iTicket as of August 15th.

Appendix A URS Email Communications with DOT & Brekford Regarding Observations
1. Email sent by URS on Thursday, July 18th Responded to by Brekford and DOT Wednesday, July 31st
From: Jacquelyn Tam [mailto:JTam@brekford.com] Sent: Wednesday, July 31, 2013 5:26 PM To: McDonald, Jamie; Lange, Brian Cc: Martinez, Liz; Sheridan, Patrick; Udenta, Francis; Vidal, Carlos A.; Mitra, Sushmita; Buettner, Mary C.; Ryan, Timothy; Metheny, Eric; Jacquelyn Tam; Mithun Ashwath; Payam Pour; Brad Schaeffer; Patti Hamilton Subject: RE: URS Initial QA Review of Test Phase Citations - LC 2054 and 2054_2MT Please see our feedback below Thanks, Jacquelyn Tam From: Lange, Brian [mailto:brian.lange@urs.com] Sent: Thursday, July 18, 2013 3:20 PM To: McDonald, Jamie; Tam, Jacquelyn; bschaeffer@brekford.com; phamilton@brekford.com; Vidal, Carlos A.; Udenta, Francis; Ryan, Timothy; Metheny, Eric Subject: URS Initial QA Review of Test Phase Citations - LC 2054 and 2054_2MT Jamie/Jacquelyn, Weve reviewed all 55 citations in our QA queue. Below is a summary table of our comments and questions. As youll see they are relatively minor. We wanted to look for any and all potential issues or concerns, no matter how small and potentially insignificant. I also included a few general questions we had about the software and review process. Please let me know if you have any questions or need clarification on our comments.

Reference Violation # Date

Location

Issue/Concerns Notes

DOT Response (RED) & Brekford Feedback (BLUE)

1. Should be Discarded 2. This image is actually not that dark (see attached plate image BC159902_plate.jpg). The key is visibly, we need to be able to match the car make and model to the license plate info returned from MVA (Chev, MD 02403M6). Of course, per DOTs directive, when in doubt, Brekford would cancel. Additionally, BPD can also reject during their review process. Please keep in mind we are also working with the printer to improve the dark images at the print level. Per our printers image quality improvement process presented to DOT, if final print out is still dark, citation would not be mailed out and will notify Brekford, Brekford would then notify DOT to void the citation.

Image May Be Too Dark - Very hard to read Would this be BC159902 7/15/2013 2054_2MT license plate admissible/defensible without in court? zooming to 400%

We understand this unit is "temporary" as BC159913 part of the equipment Image A BC159915 test. And each of seemed to have BC159916 these photos are 7/15/2013 2054_2MT triggered late relatively similar in BC159917 vehicle beyond distance beyond initial BC159918 initiation line line when camera triggers - Still may want to see why these

1. Yes. 2. Most of these are from the 2MT unit. We looked into why the image was consistently taken beyond the trigger line and made adjustment to the trigger line. However, please keep in mind the trigger line and the 2nd progression line are GUIDELINES for processors and approvers to know that the car needs to be AT LEAST at the lines or
7

Reference Violation # Date

Location

Issue/Concerns Notes were inconsistent with other photo events.

DOT Response (RED) & Brekford Feedback (BLUE) beyond. Therefore, just because the vehicle is beyond the lines, it doesnt necessary means the images are bad or should be canceled or rejected. If the vehicles have not crossed the lines, then, they should be rejected.

Image A seemed to have BC159932 7/16/2013 2054_2MT triggered late vehicle beyond initiation line Image A and B had early trigger - hard to Early triggers may BC159937 7/16/2013 2054_2MT say vehicle have been caused by BC159939 travelled van's flat sides? minimum distance

1. Same as above

1. This is a good example for our processors and reviewer. It should not be accepted because all parts of the vehicle did not completely passed the 2nd progression line. We have retrained our staff.

BC159856 7/15/2013 2054

Image A seemed to have Did flat sides on van triggered late affect reading? vehicle beyond initiation line

1. We looked into why the image was consistently taken beyond the trigger line and made adjustment to the trigger line. However, please keep in mind the trigger line and the 2nd progression line are GUIDELINES for processors and approvers to know that the car needs to be AT LEAST at the lines or beyond. Therefore, just because the vehicle is beyond the lines, it doesnt necessary means the images are bad or should be canceled or rejected. If the vehicles have not
8

Reference Violation # Date

Location

Issue/Concerns Notes

DOT Response (RED) & Brekford Feedback (BLUE) crossed the lines, then, they should be rejected.

General Questions:

DOT Response (RED) & Brekford Feedback (BLUE) 1. Yes, it needs to be un-editable as Brekford told us it would be.

1. We noticed that we can modify the .pdf in the image review area - You may want to disable this feature

2. If you have Adobe Pro, it does appear that you could modify the pdf, HOWEVER, none of the changes can be saved or override the pdf created in iP360. We cannot disable PDF features on your Adobe Pro software.

1. Good idea. 2. iManager was designed to be a tool to manage citations that have been approved and printed, thus, there was only the search field for citation number since BC# would no longer be the identification number once a violation is approved and citation number is assigned. If its a violation has been canceled/rejected, you can search by reference number (BC#) by going into canceled/rejected queue, press search, once rejected violations display as list on left, press control F, type in BC# in find field, press enter. Matching BC# will be highlighted yellow. Rejected violation images stay in reject queues for 30 days. We have also added reference search feature (BC#) to all queues.

2. We suggest adding an additional search feature to iManager so that DOT/URS can search by Reference #, rather than just Citation #, License Plate, or Name.

3. We noticed that the time of the violation is shown in 1. Brekford wanted both in military time but we said no to what the 24hr "military" format on the images, but in 12hr citizens see on the citation. "civilian" format on the Citation - Suggest using a consistent format.

1. I dont think so since they are in the public right-of-way but will defer to Law. 4. Some images have people visible - should measures be taken to ensure faces/identifiable features are blurred? 2. Currently, our software does not have this functionality since this has not been an issue or contractual requirement of any automated enforcement contracts that we know of and not part of the original requirement for this solicitation. If DOT and Law requires this function, we will look into if its possible and will provide a cost and time estimate to complete the added requirement.

5. The speeds shown on the citation are rounded down - 1. They should be truncated down to a whole #. should they be rounded at all or would it be better if left in decimal format, consistent with the format on the 2. According to DOTs business rules, speeds shown on citations are to be images? sown in hundreds of a second.

6. Many of the images of the license plates also include the yellow position line, but some do not. We recommend they be consistent and each show the yellow line for reference purposes.

1. This is not a big issue since it is the third image and all that matters is the license plate

10

2. Email sent by URS on Monday, July 22nd No Formal Response from Brekford as of Friday, August 16th
From: Lange, Brian [mailto:brian.lange@urs.com] Sent: Monday, July 22, 2013 10:41 AM To: McDonald, Jamie; Udenta, Francis; Vidal, Carlos A. Cc: Ryan, Timothy; Metheny, Eric Subject: ATVES: Equipment Mounting Height Issue Hi, folks: We've taken a look at the most recent Smartmicro data sheets forwarded by Francis, and have some questions about them. We thought it might be worth raising them with you now, rather than including them in our upcoming report. Those questions are shown on the attached Word file. To paraphrase what's in the Word file, if we're reading the Smartmicro documents correctly, they're essentially saying: Yes, the radar will work properly with mounting heights below 2 meters, but it's up to the system manufacturer (Brekford, as we understand it) to make sure that nothing else is interfering with the radar's operation with regard to each citation. Our questions would be: 1. If a citation is challenged, what would Brekford need to provide to demonstrate, to the satisfaction of the court, that nothing else is interfering with the radars operation with regard to that particular citation? 2. Is it possible for Brekford to provide that, for each citation at each location? Please let us know when youd like to discuss this further. Questions: 1. Source Document: Smartmicro_Radar_SpecSheet (e-mailed by City to URS) Statement: Mounting Height: 0.5 to 10 meters (1.6 to 33 ft) (limitations apply)
11

URS Question: Are all of the limitations described by the statement below? 2. Source Document: http://www.smartmicro.de/index.php/traffic-radar/enforcement-sensors Statement: May affect max. detection range. The best performance for the applications listed in 1.3.2 is typically achieved for mounting heights between 2-8m. Occlusion needs to be considered. Radar mounting heights between 0.5m and 2m will not affect the radar sensors speed measurement accuracy for one vehicle (as given in 1.2) but may reduce the range interval for object detection, due to occlusion and other effects. URS Questions: How much would the range interval be reduced? What other effects (in addition to occlusion) might be involved? If an individual challenged, in court, a citation issued from a location with a mounting height between 0.5m and 2m, how would Smartmicro respond to that challenge? Statement: Manufacturers of specific speed enforcement systems integrating the radar are responsible for their systems overall specifications and verifications URS Questions: Does this not put responsibility for the Baltimore City ATVES program on Brekford? If an individual challenged, in court, a citation issued from a location with a mounting height between 0.5m and 2m, how would Brekford respond to that challenge?

12

3. Email sent by URS on Tuesday, July 23rd Responded to by Brekford, Wednesday, July 31st:
From: Jacquelyn Tam [mailto:JTam@brekford.com] Sent: Wednesday, July 31, 2013 6:57 PM To: Lange, Brian Cc: Jamie.McDonald@baltimorecity.gov; Carlos.Vidal@baltimorecity.gov; Francis.Udenta@baltimorecity.gov; Ryan, Timothy; Metheny, Eric; jamesc@rjmengineering.com; Brad Schaeffer; Jacquelyn Tam; Mithun Ashwath; Payam Pour; Michael Kniffen; Patti Hamilton Subject: RE: Questions regarding URS QA/QC Review

Please see our feedback below. Thanks, Jacquelyn Tam

From: Lange, Brian [mailto:brian.lange@urs.com] Sent: Tuesday, July 23, 2013 1:38 PM To: Jacquelyn Tam Cc: Jamie.McDonald@baltimorecity.gov; Carlos.Vidal@baltimorecity.gov; Francis.Udenta@baltimorecity.gov; Ryan, Timothy; Metheny, Eric; jamesc@rjmengineering.com; Brad Schaeffer Subject: Questions regarding URS QA/QC Review Hi, Jacquelyn/Jamie:

13

Jacquelyn, thank you for this explanation, this will help us better schedule our time. However, we remain a little confused. We hope your response(s) to the following questions can help us clarify the process/issues we seem to be facing (Brekford response in blue): 1. If you recall from Jamie's email last Thursday, he'd asked that we be given access to the violations that had gone to MVA after the first review. Is that a function you are working on? It would be helpful if we could see more of the "raw" material as it's being worked on, as it would give us additional layers to review while we wait for the citations to make their way through the second round of processing. You should have view access to existing processing queues. 2. You noted that we're only being given a percentage of the previous day's citations, which is consistent with our understanding of the process. However, can you explain why our queue Monday afternoon contained 240 citations dating back to last Tuesday? Maybe this was just a blip, but it doesn't seem to match your description below. As we go through our QA process of reviewing violations processed by our processors, we may put back violations previously canceled by our processors into the processing queue. In those cases, you would see images dating back a few days. Please note it takes 1-2 days for in-state tag files to return from MVA (some tag requests sent may come back next day, some may come back in 2 days), then, 2nd reviews happen. Due to the end logs was not able to be created properly last week, starting this week, we have changed our procedure to processing violations the day after and not the same day in order to make sure both start and end logs have been successfully created (we will submit revision for the SOP). Youll see images we processed in 1st review and sent to MVA and return from MVA for 2nd review at least 1 day after violation date. According to DOTs business rules, Brekford has to process and submit violations to BPD by day 10 from violation date. 3. From the 240 items in the queue, we are only able to see 100 citations at a time. Further complicating this was that I could only see one set of 100 (many I had already reviewed last week), while James could only see a different set of 100, and neither of us could access the remaining 40. Are we doing something wrong on our end? Maybe we aren't using the search function properly? Is there a way to expand or clear out the queue to make room for more events? We have since changed the software so that anyone who has view access can view all images in the queue but cannot take any action.

14

4. If all citations we review are removed at the end of the day, is there a way can we go back and review these with DOT and Brekford Processing staff at a later time? This ties back to our previous suggestion that a "search by Reference #" function be added. We have since added the reference search function in all queues. 5. Our understanding was that we were also to review the events rejected by your Processors and those rejected by BCPD. We currently do not have access to those. It would help us better understand how the Processors and BCPD are evaluating the events if we could compare/contrast what they're accepting vs. rejecting. You should have access to that now. (URS NOTE as of Friday August 16, we still do not have access to these features) 6. Last week we were able to access the Site Book and Deployment Log info from the iCAM page to use as part of our review. Currently we are unable to access any information from the iCAM page. The Site Books are a necessary component for any review. In addition, part of our review process included verification that the deployments were being carried out properly. If Brekford does not want to give us full access to iCAM, could a link to the Deployment Logs and the Site Books be posted in the iPROCESS page? You should have access to iCAM now. A couple additional thoughts: 1. During our review yesterday and again today, we noticed that the yellow indicator line was not displayed in a consistent location among the photos. This may be due to changes being made to the system. However, its our understanding that once the system is fully functional, this line is supposed to be completely static or there could be red flags raised about the validity of the equipment and citations. We looked into why the image was consistently taken beyond the trigger line and made adjustment to the trigger line. Additionally, when we put these test units out there, the units were not affixed to the pavement as good as they would be for a normal deployment (previously placed on some gravel, etc). Thus, the camera moved slightly with vibration or if the box moved. Weve made some changes to stabilize the systems more and will secure the tray that hold the camera better this Friday to minimize camera movements and vibration. However, please keep in mind the trigger line and the 2nd progression line are GUIDELINES for processors and approvers to know that the car needs to be AT LEAST at the lines or

15

beyond. Therefore, just because the vehicle is beyond the lines, it doesnt necessary means the images are bad or should be canceled/rejected. If the vehicles have not crossed the lines, then, they should be rejected. 2. At one point it was suggested that we have a full training session together with the Processors. We feel that would be very beneficial. We want to be on the same page and hopefully address these initial issues/concerns. We held training with our processors a few weeks back and continue to communicate with them on any changes or training on specific examples/questions/directions needing clarification from DOT. Brad will make sure to include you in any training/communication we have with our processors moving forward. 3. We noticed that the radar readings are consistently different between 0.2 to 0.3 mph between PCU 2054 and 2054_2MT. This finding comes from our review of the images, and not from the data gathered during the equipment test. Im having our Engineers looking into this. 4. Lastly, just a reminder that we need copies of the final SOPs and Business Rules once they're complete. Revised SOPs and business rules comments have already been submitted to DOT. They're looking over and may have more edits. Please get the latest from Jamie.

16

4. Email sent by URS Monday, July 29th Brekford is Working on Data Request DOT Responded to Summary Spreadsheets on Friday, August 2nd:
From: Lange, Brian Sent: Monday, July 29, 2013 5:06 PM To: 'Vidal, Carlos A.'; McDonald, Jamie (Jamie.McDonald@baltimorecity.gov) (Jamie.McDonald@baltimorecity.gov); Udenta, Francis (Francis.Udenta@baltimorecity.gov) Cc: Ryan, Timothy; Metheny, Eric Subject: Equipment Test Data and Processing Status & Cancellation Summaries Jamie/Francis/Carlos, Wanted to give you a quick update from our end of the spectrum As you may already know, last Thursday (7/24) Carlos and I met with Brekford Engineers to discuss the Equipment Test Data. We reviewed the data and discussed some of the potential reasons for missing/mismatching data sets. We also established a format that would best meet the needs of URS to complete the analysis. Ive just heard from Payam that the data will be given to us on an external hard drive at the Processing Center tomorrow. Attached (below) youll find a breakdown of the Violation Processing Status from 7/15 to 7/25. Weve also provided a summary of Violation Cancellations from 7/15 to 7/25 (no data yet available for 7/26 or 7/29). We wanted to provide these summaries ahead of our progress report meeting on Wednesday so you have an idea of how the violation review work has been progressing. Please note that this data seems to change hourly, so what we submit today may not match whats on the iP360 iReport page tomorrow. Let us know if you have any questions/concerns. o On a related note, there were no citations provided for us to review at the Processing Center today. Maybe something happened on Friday that prevented violations from being captured/processed? We hadnt heard anything from Brekford. We gathered field data on Friday from Orleans/Lakewood (1263/93103/1284) and Harford/Kentucky (1351/1352). We should have draft Site Assessment Reports to you later this week/early next week.
17

Example Performance Tracking of Violation Processing Status July 15th through August 1st
Violation Date 7/15/2013 7/16/2013 7/17/2013 7/18/2013 7/19/2013 7/22/2013 7/23/2013 7/24/2013 7/25/2013 7/26/2013 7/29/2013 7/30/2013 7/31/2013 8/1/2013 Total Violations 102 112 192 199 144 210 180 169 200 168 67 158 114 104 Brekford Processing 7 7 5 13 2 9 12 11 16 0 2 6 7 46 Brekford Accepted 58 87 136 149 57 166 91 126 142 0 12 74 89 0 Brekford Cancels 37 18 51 37 85 35 77 32 42 168 53 78 18 55 Client Processing 0 0 0 9 4 5 11 80 142 0 12 74 89 0 Client Accepted 58 87 134 20 0 0 0 0 0 0 0 0 0 0 Client Rejected 0 0 0 9 4 5 11 5 0 0 0 0 0 0 Print Queue 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Printed 58 87 134 20 0 0 0 0 0 0 0 0 0 0

18

19

Example Performance Tracking of Violation Cancellation Reasons July 15th through August 1st
Cancellation Reason Clarity of Tag Dealer Tags Out of State Emergency Response Equipment Malfunction Error Radar Expired Violation Glare of Plate Government Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot Vehicle Mismatch Weather Condition Totals 37 18 51 37 85 35 7/15/2013 2 7/17/2013 2 7/15/2013 7/15/2013 7/15/2013 3 1 3 7/15/2013 13 7/16/2013 7/16/2013 7/16/2013 7/16/2013 7/16/2013 3 1 6 1 3 7/17/2013 4 7/18/2013 7/18/2013 7/18/2013 4 1 2 7/19/2013 3 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7 2 4 2 7/23/2013 3 77 32 42 168 53 78 15 7/15/2013 3 7/16/2013 2 7/15/2013 7/15/2013 1 3 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 1 1 2 2 5 1 5 6 7/18/2013 7/18/2013 7/18/2013 3 5 11 7/19/2013 1 7/22/2013 7/22/2013 7/22/2013 5 3 5 7/18/2013 7/18/2013 7/18/2013 3 1 1 7/19/2013 7/19/2013 7/19/2013 1 1 1 7/22/2013 2 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 1 1 5 5 4 1 1 2 1 7/24/2013 4 7/25/2013 7/25/2013 3 2 7/29/2013 2 7/30/2013 2 7/31/2013 1 7/24/2013 2 7/25/2013 2 7/30/2013 4 7/31/2013 1 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 3 4 4 9 4 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 4 3 4 11 6 7/29/2013 7/29/2013 1 1 7/30/2013 7/30/2013 7/30/2013 4 4 2 7/31/2013 7/31/2013 5 2 7/30/2013 4 7/31/2013 1 7/23/2013 4 7/29/2013 10 7/31/2013 1 7/18/2013 1 7/19/2013 76 7/23/2013 47 7/26/2013 168 7/29/2013 39 7/30/2013 57 Date 7/15/2013 Total 8 Date 7/16/2013 Total 2 Date 7/17/2013 Total 22 Date 7/18/2013 Total 5 Date 7/19/2013 Total 2 Date 7/22/2013 Total 5 Date 7/23/2013 7/23/2013 Total 1 1 Date 7/24/2013 Total 2 Date 7/25/2013 7/25/2013 Total 5 2 Total Date Total Date 7/30/2013 Total 1 Date 7/31/2013 Total 4

20

21

Cancellation Reason Clarity of Tag Dealer Tags Out of State Emergency Response Equipment Malfunction Error Radar Expired Violation Glare of Plate Government Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot Vehicle Mismatch Weather Condition

Date Total 7/15/2013

Date Total 8 7/16/2013

Date Total 2 7/17/2013

Date Total 22 7/18/2013 7/18/2013

Date Total 5 7/19/2013 1 7/19/2013

Date Total 7/22/2013

Date Total 7/23/2013 7/23/2013 7/23/2013

1 1 47

Date Total 7/24/2013

Date Total 7/25/2013 7/25/2013

Total 5 2 7/26/2013 168

Date

Total

Date Total 7/30/2013

Date Total 1 7/31/2013

76

7/29/2013

39

7/30/2013

57

7/15/2013 7/15/2013

1 3

7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013

3 7/16/2013 13 7/16/2013 7/16/2013 3 7/16/2013 1 7/16/2013 3 7/16/2013 2

3 1 6 1 3 7/17/2013 7/17/2013

7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013

1 1 2 2 5 1 5 6

7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013

3 7/19/2013 1 7/19/2013 1 7/19/2013 3 5 11 7/19/2013 4 1 2 7/19/2013

1 1 1

7/23/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 2 5 3 5 7 2 4 2 35 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013

4 1 1 5 5 4 1 1 2 1 3 77 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 3 4 4 9 4 2 4 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 4 3 4 11 6 2 3 2 42 168

7/29/2013

10 7/30/2013 7/30/2013 7/30/2013 7/30/2013 7/30/2013

7/31/2013 4 7/31/2013 4 4 7/31/2013 2 7/31/2013 4 7/31/2013 2 7/31/2013

1 1

7/29/2013 7/29/2013

1 1

5 2 1 1

4 7/18/2013 7/18/2013 2 7/18/2013

7/29/2013

7/30/2013

37

18

51

37

85

32

53

78

15

Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Sum

57 3 1 387 1 4 20 4 24 13 42 49 51 3 31 5 26 4 3 728

Cancellation Reason 7/15/2013 - 7/31/2013


Vehicle Mismatch 1% Temp Tags (Out of State) 1% Test-Shot 4% Rental 4% Weather Condition 0% Dealer Tags Out of State 0% Emergency Response 0%

Other 0%

Clarity of Tag 8%

Obstructed Vehicle/Plate 7%

Not Found on MVA 7%

No Violation 6%

No Rear Plate 2%

Multiple Vehicles 3%

Equipment Malfunction 53%

Government Tag 1% Glare of Plate 3% Expired Violation 1% Error Radar 0%

Cancellation Reason Clarity of Tag Error Radar Expired Violation Multiple Vehicles No Violation Obstructed Vehicle/Plate Other Rental Test-Shot

Date Total 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013

8 1 3 3 13 3 1 3 2 37

Cancellation Reason 7/15/2013


Test-Shot 5%

Other 3% Obstructed Vehicle/Plate 8%

Rental 8%

Clarity of Tag 22% Error Radar 3% Expired Violation 8% Multiple Vehicles 8%

Cancellation Reason
14 12 10 8 6 4 2 0 7/15/2013 Clarity of Tag Error Radar Expired Violation Multiple Vehicles No Violation Obstructed Vehicle/Plate Rental Test-Shot Other

No Violation 35%

Violation Reason Date Total Clarity of Tag 7/16/2013 Multiple Vehicles 7/16/2013 No Violation 7/16/2013 7/16/2013 Not Found on MVA Obstructed Vehicle/Plate 7/16/2013 7/16/2013 Other Rental 7/16/2013

2 2 3 1 6 1 3

Cancellation Reason
7 6 Clarity of Tag 5 4 3 2 1 0 7/16/2013 Obstructed Vehicle/Plate 33% Multiple Vehicles No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Other No Violation 17% Other 6% Rental 17% Clarity of Tag 11% Multiple Vehicles 11%

Cancellation Reason 7/16/2013

Not Found on MVA 5%

Cancellation Reason Clarity of Tag Expired Violation Glare of Plate Government Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Date Total 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013

22 1 1 2 2 5 1 5 6 4 2

Cancellation Reason 7/17/2013


Test-Shot 4% Rental 8% Obstructed Vehicle/Plate 11%

Cancellation Reason
25 Clarity of Tag 20 Glare of Plate Government Tag 15 Multiple Vehicles No Rear Plate Not Found on MVA 10 Obstructed Vehicle/Plate Rental 5 Test-Shot Expired Violation 0 7/17/2013 No Violation

Clarity of Tag 43%

Not Found on MVA 10%

No Violation 2%

No Rear Plate 10% Multiple Vehicles 4% Expired Violation 2%

Government Tag 4%

Glare of Plate 2%

Cancellation Reason Clarity of Tag Emergency Response Glare of Plate Government Tag Multiple Vehicles No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot

Date Total 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013

5 1 3 1 1 3 5 11 4 1 2

Cancellation Reason
12 Clarity of Tag 10 8 6 4 2 0 7/18/2013 Emergency Response Glare of Plate Government Tag Multiple Vehicles No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot Obstructed Vehicle/Plate 30% Glare of Plate 8% Government Tag 3% No Violation 8% Not Found on MVA 13% Multiple Vehicles 3%

Cancellation Reason 7/18/2013


Temp Tags (Out of State) 3% Rental 11% Test-Shot 5% Emergency Response 3%

Clarity of Tag 13%

Cancellation Reason Clarity of Tag Equipment Malfunction Glare of Plate Government Tag Multiple Vehicles Obstructed Vehicle/Plate Test-Shot

Date Total 7/19/2013 7/19/2013 7/19/2013 7/19/2013 7/19/2013 7/19/2013 7/19/2013

2 76 1 1 1 1 3

Cancellation Reason
80 70 60 50 40 Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Obstructed Vehicle/Plate Test-Shot Equipment Malfunction 7/19/2013

Clarity Obstructed of Tag Vehicle/Plate 2% 1%

Cancellation Reason 7/19/2013


Test-Shot Multiple Vehicles Government Tag 1% 4% 1% Glare of Plate 1%

30 20 10 0

Equipment Malfunction 90%

Cancellation Reason Date Total Clarity of Tag 7/22/2013 Multiple Vehicles 7/22/2013 No Violation 7/22/2013 Not Found on MVA 7/22/2013 Obstructed Vehicle/Plate 7/22/2013 Rental 7/22/2013 Temp Tags (Out of State) 7/22/2013 Test-Shot 7/22/2013 Vehicle Mismatch 7/22/2013

5 2 5 3 5 7 2 4 2

Cancellation Reason 7/22/2013


Vehicle Mismatch 6% 8 7 6 Test-Shot 11% Temp Tags (Out of State) 6% Clarity of Tag 14% 5 Multiple Vehicles 6% 4 3 2 1 No Violation 14% Rental 20% Obstructed Vehicle/Plate 14% 0

Cancellation Rreason
Clarity of Tag Multiple Vehicles No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot 7/22/2013 Vehicle Mismatch

Not Found on MVA 9%

Cancellation Reason Clarity of Tag Dealer Tags Out of State Equipment Malfunction Glare of Plate Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot Weather Condition

Date Total 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013

1 1 47 4 1 1 5 5 4 1 1 2 1 3 77

Cancellation Reason
50 45 Clarity of Tag 40 35 30 25 20 15 10 5 0 7/23/2013 Dealer Tags Out of State Glare of Plate Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot Weather Condition Equipment Malfunction Other

Cancellation Reason 7/23/2013


Temp Tags (Out of State) 3% Test-Shot Rental 1% 1% Clarity of Tag 2% Dealer Tags Out of State 1%

Other 1%

Weather Condition 4%

Obstructed Vehicle/Plate 5%

Not Found on MVA 7%

No Violation 7%

No Rear Plate 1% Multiple Vehicles 1% Glare of Plate 5%

Equipment Malfunction 61%

Cancellation Reason Date Total Clarity of Tag 7/24/2013 Multiple Vehicles 7/24/2013 No Rear Plate 7/24/2013 No Violation 7/24/2013 Not Found on MVA 7/24/2013 Obstructed Vehicle/Plate 7/24/2013 Rental 7/24/2013 Test-Shot 7/24/2013

2 3 4 4 9 4 2 4

Cancellation Reason
10 9 8 7 6 5 Clarity of Tag No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Multiple Vehicles No Violation 7/24/2013

Cancellation Reason 7/24/2013


Clarity of Tag 6% Rental 6% Test-Shot 13%

4 3 2 1 0

Multiple Vehicles 9% No Rear Plate 12% No Violation 13%

Obstructed Vehicle/Plate 13%

Not Found on MVA 28%

Cancellation Reason Clarity of Tag Dealer Tags Out of State Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013 7/25/2013

5 2 4 3 4 11 6 2 3 2

Cancellation Reason
12 Clarity of Tag 10 8 6 4 2 0 7/25/2013 Dealer Tags Out of State Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental

Cancellation Reason 7/25/2013


Vehicle Mismatch 5% Rental 5% Dealer Tags Out of State 5%

Test-Shot 7%

Clarity of Tag 12%

Obstructed Vehicle/Plate 14%

Multiple Vehicles 9% No Rear Plate 7% No Violation 10%

Not Found on MVA 26%

Cancellation Reason Equipment Malfunction Glare of Plate Not Found on MVA Obstructed Vehicle/Plate Test-Shot

Date Total 7/29/2013 7/29/2013 7/29/2013 7/29/2013 7/29/2013

39 10 1 1 2

Cancellation Reason
45 40 35 30 25 20 15 10 5 0 7/29/2013 Equipment Malfunction Glare of Plate Not Found on MVA Obstructed Vehicle/Plate Test-Shot

Cancellation Reason 7/29/2013


Obstructed Vehicle/Plate 2% Not Found on MVA 2% Test-Shot 4%

Glare of Plate 19%

Equipment Malfunction 73%

Cancellation Reason Clarity of Tag Equipment Malfunction Multiple Vehicles No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Date Total 7/30/2013 7/30/2013 7/30/2013 7/30/2013 7/30/2013 7/30/2013 7/30/2013 7/30/2013

1 57 4 4 4 2 4 2
60 50

Cancellation Reason
Clarity of Tag Equipment Malfunction Multiple Vehicles No Violation Not Found on MVA Obstructed Vehicle/Plate 10 0 7/30/2013 Rental Test-Shot

Cancellation Reason 7/30/2013


Obstructed Vehicle/Plate 3% Not Found on MVA 5% No Violation 5% Multiple Vehicles 5% Equipment Malfunction 73% Test-Shot Clarity of Tag 3% 1% Rental 5%

40 30 20

Cancellation Reason Clarity of Tag Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Date Total 7/31/2013 7/31/2013 7/31/2013 7/31/2013 7/31/2013 7/31/2013 7/31/2013

4 1 1 5 2 1 1

Cancellation Reason
6

Cancellation Reason 7/31/2013


Rental 7% Test-Shot 7%

5 4 3 2

Clarity of Tag Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot 7/31/2013

Obstructed Vehicle/Plate 13%

Clarity of Tag 27%

1 0

Not Found on MVA 33%

Glare of Plate 6% Multiple Vehicles 7%

Violation Date Total Violations Brekford Processing Brekford Accepted Brekford Cancels Client Processing Client Accepted Client Rejected Print Queue Printed 8/1/2013 105 8 37 60 1 36 0 0 36 8/2/2013 86 3 66 17 0 64 2 0 64 8/5/2013 73 4 56 13 15 40 1 0 40 8/6/2013 129 4 56 69 56 0 0 0 0 8/7/2013 103 4 65 34 65 0 0 0 0 8/8/2013 85 4 65 16 65 0 0 0 0 8/9/2013 123 2 99 22 99 0 0 0 0 8/12/2013 0 0 0 0 0 0 0 0 0 8/13/2013 108 7 84 17 84 0 0 0 0 8/14/2013 134 111 4 19 4 0 0 0 0 8/15/2013 110 4 81 25 81 0 0 0 0 8/16/2013 127 118 1 8 1 0 0 0 0 8/19/2013 0 0 0 0 0 0 0 0 0 Totals 1183 269 614 300 471 140 3 0 140

Processing Status August 2013

140 120 100 Axis Title 80 60 40 20 0 8/1/2013 8/2/2013 8/3/2013 8/4/2013 8/5/2013 8/6/2013 8/7/2013 8/8/2013 8/9/2013 Client Rejected Print Queue Brekford Processing Printed Client Accepted Client Processing Brekford Cancels Brekford Accepted Total Violations 8/10/2013 8/11/2013 8/12/2013 8/13/2013 8/14/2013

8/15/2013

8/16/2013

8/17/2013

8/18/2013

8/19/2013

Cancellation Reason Clarity of Tag Dealer Tags Out of State Emergency Response Equipment Malfunction Error Radar Expired Violation Glare of Plate Government Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot Vehicle Mismatch Weather Condition

Date Total 8/1/2013

Date Total 8/2/2013

Date Total 8/5/2013

Date Total 8/6/2013 8/6/2013

5 1

Date Total 8/7/2013

26

Date Total 8/8/2013

Date Total 8/9/2013

4 0 0

Date Total 8/13/2013

Date Total 8/14/2013

Total 8 0 8/15/2013 7

Date Total 8/16/2013

Date 1

Total 0

Date

Total 0 Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Sum 60 0 1 53 0 0 21 4 6 6 0 17 16 0 16 3 11 5 5 224

8/1/2013

53 0 0 8/2/2013 0 8/2/2013 1 0 0 1 0 1 0 0 0 0

0 0 0 0 0 0 0 1 1 2 1 1 7

0 0

0 0

8/6/2013

5 0 0 0 2 1 1 0 2 2 19

8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013

0 0 1 1 1 1 2 1 1 34

8/9/2013 8/8/2013 8/8/2013 1 1 0 0 4 4 0 2 0 1 16

5 8/13/2013 0 1 0 3 1 0 3 2 1 2 22 1 0 1 0 6 0 3 0 8/13/2013 2 17

8/14/2013 8/14/2013 8/14/2013

8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013

8/13/2013 8/13/2013

8/1/2013

8/1/2013 8/1/2013

0 0 0 0 0 0 0

8/2/2013 8/2/2013

8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013

8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013

8/8/2013 8/8/2013 8/8/2013 8/8/2013

8/14/2013

4 1 1 0 0 0 4 0

8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013

3 1 2 1 3 4 1 2 1 25

8/16/2013 8/16/2013 8/16/2013

3 1 1

0 0 0 0 0

0 0 0 0 0 0

0 0

8/13/2013

8/2/2013

8/14/2013

1 0 19

8/16/2013 8/16/2013

1 1

53

Cancellation Reason 8/1/2013 - 8/16/2013


Weather Condition 2% Vehicle Mismatch 2%

8/5/2013 - 8/9/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

39 0 0 0

40% 0% 0% 0%

8/12/2013 - 8/16/2013 Clarity of Tag Equipment Malfunctio Error Radar Expired Violation

20 0 0 0

29% 0% 0% 0%

Temp Tags (Out of State) 1%

Test-Shot 5%

Emergency Response No Violation Test-Shot

1 0 7

1% 0% 7%

Emergency Response No Violation Test-Shot

0 0 4

0% 0% 6%

Rental 7% Other 0%

Clarity of Tag 27%

Obstructed Vehicle/Plate 7% Dealer Tags Out of State 0% Emergency Response 0%

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plat Other Rental Temp Tags (Out of State Vehicle Mismatch Weather Condition

0 10 0 2 3 7 8 0 12 2 4 3 98

0% 10% 0% 2% 3% 7% 8% 0% 12% 2% 4% 3% 98

Dealer Tags Out of Sta Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Pl Other Rental Temp Tags (Out of Sta Vehicle Mismatch Weather Condition

0 10 4 4 2 9 8 0 4 1 1 2 69

0% 14% 6% 6% 3% 13% 12% 0% 6% 1% 1% 3% 69

Not Found on MVA 8%

No Violation 0%

No Rear Plate 3% Multiple Vehicles 3% Equipment Malfunction 24%

Government Tag 2% Glare of Plate 9%

Expired Error Radar 0% Violation 0%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Temp Tags (Out of State) Test-Shot

Date Total 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013

1 3 1 1 1 1 8
4

Cancellation Reason Cancellation Reason 8/16/2013


3 3 2 2 Test-Shot 13% Clarity of Tag 12% 1 1 0 8/16/2013 Temp Tags (Out of State) 13% Multiple Vehicles 13% Clarity of Tag Glare of Plate Multiple Vehicles Temp Tags (Out of State) Test-Shot Government Tag

Glare of Plate 37%

Government Tag 12%

Cancellation Reason Clarity of Tag Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013

1 1 1 2 1 1

Cancellation Reason 8/5/2013

Cancellation Reason
2.5

Vehicle Mismatch 14%

Clarity of Tag 15%

Test-Shot 14% 2 Clarity of Tag 1.5 Not Found on MVA Obstructed Vehicle/Plate 1 Rental Test-Shot Vehicle Mismatch 0.5 Rental 29%

Not Found on MVA 14% Obstructed Vehicle/Plate 14%

0 8/5/2013

Cancellation Reason Clarity of Tag Emergency Response Glare of Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013

5 1 5 2 1 1 2 2 19

Cancellation Reason
6 5 4 3 2 1 0 8/6/2013 Obstructed Vehicle/Plate 5% Clarity of Tag Emergency Response Glare of Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/6/2013

Vehicle Mismatch 11% Test-Shot 11% Rental 5% Emergency Response 5% Not Found on MVA 11% Clarity of Tag 26%

Glare of Plate 26%

Cancellation Reason Clarity of Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013

26 1 1 1 1 2 1 1 34

Cancellation Reason
30 25 20 15 10 Clarity of Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch 8/7/2013

Cancellation Reason 8/7/2013


Test-Shot 3% Obstructed Vehicle/Plate 3% Not Found on MVA 3% No Rear Plate 3% Multiple Vehicles 3% Vehicle Mismatch 3%

5 0

Rental 6%

Clarity of Tag 76%

Cancellation Reason Date Total Clarity of Tag 8/8/2013 Multiple Vehicles 8/8/2013 No Rear Plate 8/8/2013 Obstructed Vehicle/Plate 8/8/2013 Rental 8/8/2013 Test-Shot 8/8/2013 Weather Condition 8/8/2013

3 1 1 4 4 2 1 16
4.5

Cancellation Rreason Cancellation Reason 8/8/2013


Weather Condition 6% 4 3.5 3 2.5 2 1.5 Test-Shot 13% Clarity of Tag 19% Multiple Vehicles 6% No Rear Plate 6% Rental 25% Obstructed Vehicle/Plate 25% 1 0.5 0 8/8/2013 Clarity of Tag Multiple Vehicles No Rear Plate Obstructed Vehicle/Plate Rental Test-Shot Weather Condition

Cancellation Reason Clarity of Tag Glare of Plate No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot Weather Condition

Date Total 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013

4 5 1 3 1 3 2 1 2 22

Cancellation Reason
6

5 Clarity of Tag 4 Glare of Plate No Rear Plate Not Found on MVA 3 Obstructed Vehicle/Plate Rental 2 Temp Tags (Out of State) Test-Shot 1 Weather Condition

0 8/9/2013

Cancellation Reason 8/9/2013

Weather Condition 9% Test-Shot 5% Clarity of Tag 18%

Temp Tags (Out of State) 9%

Rental 14%

Glare of Plate 23%

Obstructed Vehicle/Plate 4%

Not Found on MVA 14%

No Rear Plate 4%

Cancellation Reason Clarity of Tag Government Tag No Rear Plate Not Found on MVA Rental Weather Condition

Date Total 8/13/2013 8/13/2013 8/13/2013 8/13/2013 8/13/2013 8/13/2013

4 1 1 6 3 2 17

Cancellation Reason
7 6 5 4 Clarity of Tag Government Tag No Rear Plate Not Found on MVA Rental Weather Condition

Cancellation Reason 8/13/2013

3 2 1

Weather Condition 12% Rental 18%

0 Clarity of Tag 23% 8/13/2013

Government Tag 6%

Not Found on MVA 35%

No Rear Plate 6%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicle Obstructed Vehicle/Plate Test-Shot

Date Total 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013

8 4 1 1 4 1

Cancellation Reason
9 8 7 6 5 4 3 2 1 0 8/14/2013 Clarity of Tag Glare of Plate Government Tag Multiple Vehicle Obstructed Vehicle/Plate Test-Shot

Cancellation Reason 8/14/2013


Test-Shot 5%

Obstructed Vehicle/Plate 21%

Clarity of Tag 42%

Multiple Vehicle 5% Government Tag 6%

Glare of Plate 21%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicle No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013

7 3 1 2 1 3 4 1 2 1

Cancellation Reason
8 7 6 5 4 3 Clarity of Tag Glare of Plate Government Tag Multiple Vehicle No Rear Plate Not Found on MVA Obstructed Vehicle/Plate

25

2 1 0 8/15/2013

Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/15/2013


Vehicle Mismatch 4%

Test-Shot 8% Rental 4%

Clarity of Tag 28%

Obstructed Vehicle/Plate 16%

Glare of Plate 12% Not Found on MVA 12%

Multiple Vehicle 8% No Rear Plate 4%

Government Tag 4%

Cancellation Reason Clarity of Tag Dealer Tags Out of State Emergency Response Equipment Malfunction Error Radar Expired Violation Glare of Plate Government Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot Vehicle Mismatch Weather Condition Sum

Date Total 7/15/2013

Date Total 7/16/2013

Date Total 7/17/2013

22

Date Total 7/18/2013 7/18/2013

4 1

Date Total 7/19/2013

Date Total 7/22/2013

Date Total 7/23/2013 7/23/2013 7/23/2013

1 1 1

Date Total 7/24/2013

Date Total 7/25/2013 7/25/2013

Date 5 2

Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Sum 49 3 1 1 1 3 9 4 17 11 35 21 44 3 25 5 21 2 3 258

7/15/2013 7/15/2013

1 3 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 1 2 2 5 1 5 6 4 2 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 7/18/2013 3 1 1 3 4 11 4 1 2 7/19/2013 7/19/2013 7/19/2013 1 1 1 7/23/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 2 5 3 5 7 2 4 2 35 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 37 18 50 35 8 4 1 1 5 5 4 1 1 2 1 3 31 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 1 2 1 3 2 1 4 7/25/2013 7/25/2013 7/25/2013 7/25/2013 25-Jul 7/25/2013 4 3 4 6 2 3

7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013

3 13 3 1 3 2

7/16/2013 7/16/2013 7/16/2013 7/16/2013 7/16/2013 7/16/2013

2 3 1 6 1 3

7/19/2013

7/19/2013

15

29

Cancellation Reason 7/15/2013 - 7/25/2013


Vehicle Mismatch 1% Weather Condition 1%

Temp Tags (Out of State) 2%

Test-Shot 8% Clarity of Tag 19% Dealer Tags Out of State 1%

Rental 10%

Emergency Response 0% Equipment Malfunction 0%

Other 1% Glare of Plate 3%

Error Radar 0%

Obstructed Vehicle/Plate 17%

Government Tag 2% Multiple Vehicles 7%

Expired Violation 1%

No Rear Plate 4% Not Found on MVA 8%

No Violation 14%

Cancellation Reason Date Clarity of Tag Error Radar Expired Violation Multiple Vehicles No Violation Other Obstructed Vehicle/Plate Rental Test-Shot

Total 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 7/15/2013 8 1 3 3 13 1 3 3 2

Cancellation Reason 7/15/2013


Test-Shot 5% 14 12 Obstructed Vehicle/Plate 8% Other 3% Expired Violation 8% Multiple Vehicles 8% Rental 8% Clarity of Tag 22% Error Radar 3%

Cancellation Reason

Clarity of Tag 10 Error Radar Expired Violation 8 Multiple Vehicles No Violation 6 Other Obstructed Vehicle/Plate 4 Rental Test-Shot 2

No Violation 35%

0 7/15/2013

Violation Reason Date Total 7/16/2013 Clarity of Tag 7/16/2013 Multiple Vehicles No Violation 7/16/2013 7/16/2013 Not Found on MVA Obstructed Vehicle/Plate 7/16/2013 Other 7/16/2013 Rental 7/16/2013

2 2 3 1 6 1 3

Cancellation Reason 7/16/2013


7 6 5 4 3 2 1 Not Found on MVA 5% 0 Clarity of Tag 11%

Cancellation Reason

Rental 17% Other 6%

Clarity of Tag Multiple Vehicles No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental

Multiple Vehicles 11%

Obstructed Vehicle/Plate 33%

No Violation 17%

7/16/2013

Cancellation Reason Date Clarity of Tag Glare of Plate Government Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Total 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 7/17/2013 22 1 2 2 5 1 5 6 4 2

Cancellation Reason 7/17/2013


Test-Shot 4% 25

Cancellation Reason

Rental 8% Obstructed Vehicle/Plate 12% Not Found on MVA 10%

20

Clarity of Tag Glare of Plate Government Tag

15 Clarity of Tag 44% 10

Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate

No Violation 2% Multiple Vehicles 4%

No Rear Plate 10%

Rental Test-Shot

Government Tag 4%

Glare of Plate 2%

0 7/17/2013

Cancellation Reason Date Total Clarity of Tag 7/18/2013 Emergency Response 7/18/2013 Glare of Plate 7/18/2013 Government Tag 7/18/2013 Multiple Vehicles 7/18/2013 No Violation 7/18/2013 7/18/2013 Not Found on MVA Obstructed Vehicle/Plate 7/18/2013 Rental 7/18/2013 Temp Tags (Out of State) 7/18/2013 Test-Shot 7/18/2013

4 1 3 1 1 3 4 11 4 1 2

Cancellation Reason 7/18/2013


Temp Tags (Out of State) 3% Test-Shot 6% Emergency Response 3% 12

Cancellation Reason

Clarity of Tag 11% Rental 11%

10

Clarity of Tag Emergency Response

8 Glare of Plate 9%

Glare of Plate Government Tag

Government Tag 3% Multiple Vehicles 3%

Multiple Vehicles 6 No Violation Not Found on MVA 4 Obstructed Vehicle/Plate Rental 2 Temp Tags (Out of State) Test-Shot 0 7/18/2013

Obstructed Vehicle/Plate 31% No Violation 9% Not Found on MVA 11%

Cancellation Reason Date Total Clarity of Tag 7/19/2013 Glare of Plate 7/19/2013 Government Tag 7/19/2013 Multiple Vehicles 7/19/2013 Obstructed Vehicle/Plate 7/19/2013 Test-Shot 7/19/2013

1 1 1 1 1 3

Cancellation Reason 7/19/2013


3.5 3 Clarity of Tag 12% Test-Shot 38% 2.5 2 1.5 1 Multiple Vehicles 13% 0.5 0

Cancellation Reason

Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Obstructed Vehicle/Plate Test-Shot

Glare of Plate 12% Government Tag 12%

Obstructed Vehicle/Plate 13%

7/19/2013

Cancellation Reason Date Clarity of Tag Multiple Vehicles No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot Vehicle Mismatch

Total 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 7/22/2013 5 2 5 3 5 7 2 4 2

Cancellation Reason 7/22/2013


Vehicle Mismatch 6% 6

Cancellation Rreason

5 Test-Shot 11% Temp Tags (Out of State) 6% Clarity of Tag 14% Clarity of Tag Multiple Vehicles 6% 4 Multiple Vehicles No Violation Not Found on MVA 3 No Violation 14% Rental 20% 2 Not Found on Obstructed MVA Vehicle/Plate 9% 14% Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot 1 Vehicle Mismatch

0 7/22/2013

Cancellation Reason Date Clarity of Tag Dealer Tags Out of State Glare of Plate Multiple Vehicles No Rear Plate Equipment Malfunction No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot Weather Condition

Total 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 7/23/2013 1 1 4 1 1 1 5 5 4 1 1 2 1 3 31

Cancellation Reason 7/23/2013


Clarity of Tag 4% Test-Shot 3% Temp Tags (Out of State) 7% Rental 3% Other 3% Obstructed Vehicle/Plate 13% Weather Condition 10% Glare of Plate 13% Multiple Vehicles 3% No Rear Plate 3% Equipment Malfunction 3% 3 Dealer Tags Out of State 3% 6

Cancellation Reason
Clarity of Tag 5 Dealer Tags Out of State Glare of Plate 4 Multiple Vehicles No Rear Plate Equipment Malfunction No Violation Not Found on MVA 2 Obstructed Vehicle/Plate Other 1 Rental Temp Tags (Out of State) 0 7/23/2013 Test-Shot

No Violation 16%

Not Found on MVA 16%

Cancellation Reason Date Clarity of Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Total 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 1 1 2 1 3 2 1 4

Cancellation Reason 7/24/2013


Multiple Vehicles 7% 4.5 4 3.5 Test-Shot 29% No Rear Plate 14% No Violation 7% Rental 7% Obstructed Vehicle/Plate 14% Not Found on MVA 22% 3 2.5 2 1.5 1 0.5 0

Cancellation Reason

Clarity of Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

7/24/2013

Cancellation Reason Clarity of Tag Dealer Tags Out of State Multiple Vehicles No Rear Plate No Violation Obstructed Vehicle/Plate Rental Test-Shot

Date Total 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013 7/24/2013

5 2 4 3 4 6 2 3

Cancellation Reasons 7/25/13


7 6 Clarity of Tag 17% Dealer Tags Out of State 7% Multiple Vehicles 14% 5 4 3 2 No Rear Plate 10% 1 0

Cancellation Reasons 7/25/13

Test-Shot 10% Rental 7%

Clarity of Tag Dealer Tags Out of State Multiple Vehicles No Rear Plate No Violation Obstructed Vehicle/Plate Rental Test-Shot

Obstructed Vehicle/Plate 21%

No Violation 14%

7/24/2013

DRAFT - Specific Key Performance Metrics (KPMs) During Test Run


Metric Data Components(Description) Controllable Cancellations by Vendor Citation should have been issued but wasnt due to vendor.

06/24/13

Comments Equipment malfunction; not sent to BPD in time, etc.

7/15 -7/26/2013 7/29-8/2/2013 Comments Comments Clarity of Tag - 9% (51), Equipment Malfunction - 50% Clarity of Tag 2% (4), Equipment Malfunction 29% Dealer Tags Out of State - 1% (3), Glare of Plate - 2% (9), Government Tag - 1% (4), Multiple Vehicles - 3% Glare of Plate - 4% (11), Multiple Vehicles 1% (3), No (19), No Rear Plate - 2% (13), Not Found on MVA - 7% Rear Plate - 1% (1), Not Found on MVA - 2% (6), (39), Obstructed Vehicle/Plate - 8% (46), Other - 1 % Obstructed Vehicle/Plate 1% (3), Rental - 1% (3) (3), Rental - 4% (26), Temp Tags (Out of State) - 1% (5), Vehicle Mismatch - 1% (4), Weather Condition - 1% (3) Emergency Response - 0% (1), No Violation - 7% (38), No Violation - 1% (2), Test-Shot 2% (5) Test-Shot - 4% (21) Data Review Underway Additional formatting of data requested Total Violations: 1676 BPD Start Up Log Error: 0 BPD Close Out Log Error: 2 Data Review Underway Additional formatting of data requested Total Violations: 532 BPD Start Up Log Error: 0 BPD Close Out Log Error: 1
Vendor Accepts :280 BPD Rejects: 0

Uncontrollable Cancellations by Vendor by Reason and Location Vendor

Citation should have been issued but wasnt, not due to vendor.

Multiple vehicles in image, info not found at MVA, etc. Non-Violations Canceled by Vendor by Reason and Location Mounting Height validation No violation occurred so canceled Speed measurements are the fairly same at 1 meter and 2 meters. Results look acceptable. Will refer to Law with report. Violations Canceled by Vendor/Total Violations captured Funeral procession, second speed below threshold, etc. 3-day data collection with units side-by-side, analysis by URS

Vendor Cancellation Rate # of times PCU was unable to setup properly # of times PCU was unable to close out properly BPD Rejection Rate Controllable Violations Rejected by BPD by Reason and Location DOT

Initial Analyst or 2nd Analyst cancels.

Violations Rejected by BPD/Total Violations Accepted by Vendor; should be under 10% Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc.

Vendor Accepts :1012 BPD Rejects: 48 Percent Reject: 5%

Clarity of Plate: 25 Glare of Plate: 5 Multiple Vehicles: 11 Obstructed Vehicle/Plate: 5 Stolen Plate: 1 No Violation: 1 N/A

Clarity of Plate: 0 Glare of Plate: 0 Multiple Vehicles: 0 Obstructed Vehicle/Plate: 0 Stolen Plate: 0 No Violation: 0 N/A

Uncontrollable Violations Rejected by Citation should have been issued but wasnt, not due to BPD by Reason and Location vendor. Multiple vehicles in image, info not found at MVA, etc. Non-Violations Rejected by BPD by Reason and Location DOT Voids - Total No violation occurred so canceled Total Citations Voided by DOT Total Voided Citations by Reason; Under Investigation (UI) codes: Stolen Vehicle (SV), Stolen Tags (ST), Owner Death (OD), Funeral Procession (FP), Bankruptcy (BR), Official Police Business (PD), Rental/Lease Exemptions (RE), Voided by DOT (VD) Funeral procession, second speed below threshold, etc.

Voids by Reason

See Attached Spreadsheet

See Attached Spreadsheet

MOIT/ DOT-IT

# of errors in daily data uploads from # of citations that failed to upload to MOITs mainframe per day # of discrepancies in data sets Dummy files during Test Run. Check every week. Problem in the past with openbaltimore data. between MOIT and iP360.

General Performance Metrics During Test Run


Metric Description Rejection Codes in iP360 match the PDF conversion of citations in iP360 is Citations are cast in stone; same in iP360 as print out. working properly iP360 is working properly Comments DOT verifies. DOT verifies. Latest Business Rules Not Yet Finalized Working with Printer to Ensure .PDFs are not being modified Vendor is working with BPD to address Closeout Log Issues. IP360 is working well during test phase at LC 2054. Brekford addressed initial issues with DOT Consultant Queues Latest Business Rules Not Yet Finalized Working with Printer to Ensure .PDFs are not being modified Vendor is working with BPD to address Closeout Log Issues. IP360 is working well during test phase at LC 2054.

Data is complete and accurate; new version (3.0) is working properly; able to handle test run; rolling right data is separated Vendor isn't making any changes to the data or purging any data. from straight through; separate test run data from real data Queues listed in Business Rules. All reports are done properly and on time including the monthly report in SHAs format. Images and videos are accessible. BPD verifies. DOT verifies.

Queues in iP360 are properly filled Reports are generated accurately Test run data is in Public iP360 domain Updated citation template is being used. All vendors SOPs are being properly followed. Processing rate is uniform. iCourt has documents as 1 PDF per case No major problems with dark shots, sun glare, time stamps, etc. No changes are made without DOT approval. All citations are mailed to DOT before the mail dates. iP360 to reflect data by the next morning.

Vendor

Consultant will be on site to oversee vendors operations. No lopsided huge mass processing in one day. DOT verifies. DOT verifies. DOT verifies. Maintain proper communication with the client. Deliver to DOT by 13th day from violation date for in state, 29th DOT verifies. day for out of state. Glare of Plate is 2% of Cancellations

BPD

Officers are reviewing PDFs also. All City's SOPs are being properly Program is running error free There are no erroneous citations. Phony Trial Requests

Report problems/issues to DOT daily.

DOT

DOT will review all citations. Total # of phony trial requests created same as total # trial BRC will determine which citations to make trial requests for. requests received by DOT and vendor. Dummy files. Total # of phony payment, trial and flagging created is same as total # of trial, payment, and flagging data received by DOT and BRC will make up data to test data transfers. vendor. Dummy files. DOT-IT will download data from vendor to OnBase daily. Automated daily data transfer is occurring between Brekford, MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT DOT verifies. DOT-IT DOT-IT DOT-IT

BRC Phony payment, trial and flagging

MOIT/ DOT-IT

DOT Traffic can retrieve data in Payment, trial and flagging data is uploaded into iP360 daily Reports and data accessible in csv format Monthly report sent to DOT to check invoices, accessible on Mainframe also.

Additional Performance Metrics When We Go Live


Cases Dismissed Rate by Location DOT Cases Upheld Rate by Location Cases Dismissed Rate by Reason Total $ Collected from Paid Citations Total # of Delinquent Citations Total Trial Requests by Location Monitor citation status BRC Cases Dismissed by Location/Total Cases on Docket by Location Cases Upheld by Location/Total Cases on Docket by Location; gauge court outcomes by location. Cases Dismissed by Reason/Total Cases on Docket total $ collected from paid citations; separate speed and red light payments. Update monthly for CitiStat. Total value of unpaid citation fines; separate speed and red light. Update monthly for CitiStat. Total and Monthly basis for CitiStat. Total # of paid citations, unpaid (delinquent citations), flagged vehicles, trial requests by location, adjudication outcomes

BRC BRC BRC

DRAFT - Specific Key Performance Metrics (KPMs) During Test Run


Metric Data Components(Description) Controllable Cancellations by Vendor Citation should have been issued but wasnt due to vendor

06/24/13

Comments Equipment malfunction; not sent to BPD in time, etc

7/15 -7/26/2013 7/29-8/2/2013 Comments Comments Clarity of Tag - 9% (51), Equipment Malfunction - 50% Clarity of Tag 2% (4), Equipment Malfunction 29%

8/5-8/9/2013 Comments Clarity of Tag - 44% (39)

8/12-8/16/2013 Comments

Uncontrollable Cancellations by Vendor by Reason and Location Vendor

Citation should have been issued but wasnt, not due to vendor.

Multiple vehicles in image, info not found at MVA, etc. Non-Violations Canceled by Vendor by Reason and Location Mounting Height validation No violation occurred so canceled Speed measurements are the fairly same at 1 meter and 2 meters. Results look acceptable. Will refer to Law with report. Funeral procession, second speed below threshold, etc. 3-day data collection with units side-by-side, analysis by URS

Glare of Plate - 11% (10), Multiple Vehicles - 2% (2), No Dealer Tags Out of State - 1% (3), Glare of Plate - 2% Glare of Plate - 4% (11), Multiple Vehicles 1% (3), No Rear Plate - 3% (3), Not Found on MVA - 5% (4), (9), Government Tag - 1% (4), Multiple Vehicles - 3% Rear Plate - 1% (1), Not Found on MVA - 2% (6), Obstructed Vehilce/Plate - 9% (8), Rental - 6% (5), (19), No Rear Plate - 2% (13), Not Found on MVA - 7% Obstructed Vehicle/Plate 1% (3), Rental - 1% (3) Temp Tags(Out of State) - 2% (2), Vehicle Mismatch (39), Obstructed Vehicle/Plate - 8% (46), Other - 1 % 5%(4), Weather Condition - 3% (3) (3), Rental - 4% (26), Temp Tags (Out of State) - 1% (5), Vehicle Mismatch - 1% (4), Weather Condition - 1% (3) Emergency Response - 0% (1), No Violation - 7% (38), No Violation - 1% (2), Test-Shot 2% (5) Emergency Response - 1% (1), Test-Shot - 8% (7) Test-Shot - 4% (21) Data Review Underway Additional formatting of data requested Total Violations: 1676 BPD Start Up Log Error: 0 BPD Close Out Log Error: 2 Data Review Underway Additional formatting of data Brekford provided correlated data in a format requested sufficient for URS's analysis - URS analysis underway Total Violations: 532 BPD Start Up Log Error: 0 BPD Close Out Log Error: 1
Vendor Accepts: 280 BPD Rejects: 0

Vendor Cancellation Rate # of times PCU was unable to setup properly # of times PCU was unable to close out properly BPD Rejection Rate Controllable Violations Rejected by BPD by Reason and Location DOT

Violations Canceled by Vendor/Total Violations captured should Initial Analyst or 2nd Analyst cancels.

Total Violations: 513 BPD Start Up Log Error: 0 BPD Close Out Log Error: 0
Vendor Accepts: 341 BPD Rejects: 0

Violations Rejected by BPD/Total Violations Accepted by Vendor; should be under 10% Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc.

Vendor Accepts: 1012 BPD Rejects: 48 Percent Reject: 5%

Clarity of Plate: 25 Glare of Plate: 5 Multiple Vehicles: 11 Obstructed Vehicle/Plate: 5 Stolen Plate: 1 No Violation: 1 N/A

Clarity of Plate: 0 Glare of Plate: 0 Multiple Vehicles: 0 Obstructed Vehicle/Plate: 0 Stolen Plate: 0 No Violation: 0 N/A

Clarity of Plate: 0 Glare of Plate: 0 Multiple Vehicles: 0 Obstructed Vehicle/Plate: 0 Stolen Plate: 0 No Violation: 0 N/A

Uncontrollable Violations Rejected by Citation should have been issued but wasnt, not due to vendor. BPD by Reason and Location Multiple vehicles in image, info not found at MVA, etc. Non-Violations Rejected by BPD by Reason and Location DOT Voids - Total No violation occurred so canceled Total Citations Voided by DOT Total Voided Citations by Reason; Under Investigation (UI) codes: Stolen Vehicle (SV), Stolen Tags (ST), Owner Death (OD), Funeral Procession (FP), Bankruptcy (BR), Official Police Business (PD), Rental/Lease Exemptions (RE), Voided by DOT (VD) Funeral procession, second speed below threshold, etc.

Voids by Reason

See Attached Spreadsheet

See Attached Spreadsheet

See Attached Spreadsheet

MOIT/ DOT-IT

# of errors in daily data uploads from # of citations that failed to upload to MOITs mainframe per day # of discrepancies in data sets Dummy files during Test Run. Check every week. Problem in the past with openbaltimore data. between MOIT and iP360.

General Performance Metrics During Test Run


Metric Description Rejection Codes in iP360 match the PDF conversion of citations in iP360 is Citations are cast in stone; same in iP360 as print out. working properly iP360 is working properly Comments DOT verifies. DOT verifies. Latest Business Rules Not Yet Finalized Working with Printer to Ensure .PDFs are not being modified Vendor is working with BPD to address Closeout Log Issues. IP360 is working well during test phase at LC 2054. Brekford addressed initial issues with DOT Consultant Queues Latest Business Rules Not Yet Finalized Working with Printer to Ensure .PDFs are not being modified Vendor is working with BPD to address Closeout Log Issues. IP360 is working well during test phase at LC 2054. Latest Business Rules Not Yet Finalized Working with Printer to Ensure .PDFs are not being modified

Data is complete and accurate; new version (3.0) is working properly; able to handle test run; rolling right data is separated Vendor isn't making any changes to the data or purging any data. from straight through; separate test run data from real data Queues listed in Business Rules. BPD verifies.

Queues in iP360 are properly filled Reports are generated accurately

All reports are done properly and on time including the monthly DOT verifies. report in SHAs format.

Test run data is in Public iP360 domain Images and videos are accessible. Vendor Updated citation template is being used. All vendors SOPs are being properly followed. Processing rate is uniform. iCourt has documents as 1 PDF per case No major problems with dark shots, sun glare, time stamps, etc. No changes are made without DOT approval. All citations are mailed to DOT before the mail dates. iP360 to reflect data by the next morning.

Consultant will be on site to oversee vendors operations. No lopsided huge mass processing in one day. DOT verifies. DOT verifies. DOT verifies. Maintain proper communication with the client. Deliver to DOT by 13th day from violation date for in state, 29th DOT verifies. day for out of state. Glare of Plate is 2% of Cancellations

BPD

Officers are reviewing PDFs also. All City's SOPs are being properly Program is running error free There are no erroneous citations. Phony Trial Requests

Report problems/issues to DOT daily.

DOT

DOT will review all citations. Total # of phony trial requests created same as total # trial BRC will determine which citations to make trial requests for. requests received by DOT and vendor. Dummy files. Total # of phony payment, trial and flagging created is same as total # of trial, payment, and flagging data received by DOT and BRC will make up data to test data transfers. vendor. Dummy files. DOT-IT will download data from vendor to OnBase daily. Automated daily data transfer is occurring between Brekford, MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT DOT verifies. DOT-IT DOT-IT DOT-IT

BRC Phony payment, trial and flagging

MOIT/ DOT-IT

DOT Traffic can retrieve data in Payment, trial and flagging data is uploaded into iP360 daily Reports and data accessible in csv format Monthly report sent to DOT to check invoices, accessible on Mainframe also.

Additional Performance Metrics When We Go Live


Cases Dismissed Rate by Location DOT Cases Upheld Rate by Location Cases Dismissed Rate by Reason Total $ Collected from Paid Citations Total # of Delinquent Citations Total Trial Requests by Location Monitor citation status BRC Cases Dismissed by Location/Total Cases on Docket by Location Cases Upheld by Location/Total Cases on Docket by Location; gauge court outcomes by location. Cases Dismissed by Reason/Total Cases on Docket total $ collected from paid citations; separate speed and red light payments. Update monthly for CitiStat. Total value of unpaid citation fines; separate speed and red light. Update monthly for CitiStat. Total and Monthly basis for CitiStat. Total # of paid citations, unpaid (delinquent citations), flagged vehicles, trial requests by location, adjudication outcomes

BRC BRC BRC

DRAFT - Specific Key Performance Metrics (KPMs) During Test Run


Metric Data Components(Description) Controllable Cancellations by Vendor Citation should have been issued but wasnt due to vendor. by Reason and Location

06/24/13
Comments

7/15 -7/26/2013 Comments

7/29-8/2/2013 Comments

8/5-8/9/2013 Comments Clarity of Tag - 40% (39)

8/12-8/16/2013 Comments Clarity of Tag - 29% (20)

Equipment malfunction; not sent to BPD in time, etc.

Clarity of Tag - 9% (51), Equipment Malfunction - 50% Clarity of Tag - 3% (6), Equipment Malfunction - 71% (291), Error Radar - 0% (1), Expired Violation 1% (4) (149), Error Radar - 4% (2)

Vendor

Uncontrollable Cancellations by Vendor by Reason and Location

Citation should have been issued but wasnt, not due to vendor.

Multiple vehicles in image, info not found at MVA, etc. Non-Violations Canceled by Vendor by Reason and Location Mounting Height validation No violation occurred so canceled Speed measurements are the fairly same at 1 meter and 2 meters. Results look acceptable. Will refer to Law with report. Funeral procession, second speed below threshold, etc. 3-day data collection with units side-by-side, analysis by URS

Dealer Tags Out of State - 1% (3), Glare of Plate - 2% Glare of Plate - 6% (12), Multiple Vehicles - 2% (5), No (9), Government Tag - 1% (4), Multiple Vehicles - 3% Rear Plate - 1% (2), Not Found on MVA - 5% (11), (19), No Rear Plate - 2% (13), Not Found on MVA - 7% Obstructed Vehilce/Plate - 2% (5), Rental - 2% (5) (39), Obstructed Vehicle/Plate - 8% (46), Other - 1 % (3), Rental - 4% (26), Temp Tags (Out of State) - 1% (5), Vehicle Mismatch - 1% (4), Weather Condition - 1% (3) Emergency Response - 0% (1), No Violation - 7% (38), No Violation - 2% (4), Test-Shot - 4% (8) Test-Shot - 4% (21) Data Review Underway Additional formatting of data requested Total Violations: 1676 BPD Start Up Log Error: 0 BPD Close Out Log Error: 2

Glare of Plate - 14% (10), Government Tags - 6% Glare of Plate - 10% (10), Multiple Vehicles - 2% (2), No (4), Multiple Vehicles - 6% (4), No Rear Plate - 3% Rear Plate - 3% (3), Not Found on MVA - 7% (7), (2), Not Found on MVA - 13% (9), Obstructed Obstructed Vehilce/Plate - 8% (8), Rental - 12% (12), Vehilce/Plate - 12% (8), Rental - 6% (4), Temp Temp Tags(Out of State) - 2% (2), Vehicle Mismatch Tags(Out of State) - 1% (1), Vehicle Mismatch - 1% 4% (4), Weather Condition - 3% (3) (1), Weather Condition - 3% (2) Emergency Response - 1% (1), Test-Shot - 7% (7) Test-Shot - 6% (4)

Data Review Underway Additional formatting of data Brekford provided correlated data in a format requested sufficient for URS's analysis - URS analysis underway Total Violations: 532 BPD Start Up Log Error: 0 BPD Close Out Log Error: 1
Vendor Accepts: 280 BPD Rejects: 4

URS working on analysis Total Violations: 556 BPD Start Up Log Error: 0 BPD Close Out Log Error: 0
Vendor Accepts: 170 BPD Rejects: 0

Vendor Cancellation Rate # of times PCU was unable to setup properly # of times PCU was unable to close out properly BPD Rejection Rate Controllable Violations Rejected by BPD by Reason and Location DOT

Violations Canceled by Vendor/Total Violations captured should Initial Analyst or 2nd Analyst cancels.

Total Violations: 513 BPD Start Up Log Error: 0 BPD Close Out Log Error: 0
Vendor Accepts: 341 BPD Rejects: 17

Violations Rejected by BPD/Total Violations Accepted by Vendor; should be under 10% Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc.

Vendor Accepts: 1012 BPD Rejects: 48 Percent Reject: 5%

Clarity of Plate: 25 Glare of Plate: 5 Multiple Vehicles: 11 Obstructed Vehicle/Plate: 5 Stolen Plate: 1 No Violation: 1 N/A

Clarity of Plate: 2 Glare of Plate: 0 Multiple Vehicles: 0 Obstructed Vehicle/Plate: 0 Stolen Plate: 0 Dark Environment: 2 No Violation: 0 N/A

Clarity of Plate: 8 Glare of Plate: 3 Multiple Vehicles: 2 Obstructed Vehicle/Plate: 0 Stolen Plate: 0 No Violation: 0 N/A

Clarity of Plate: 0 Glare of Plate: 0 Multiple Vehicles: 0 Obstructed Vehicle/Plate: 0 Stolen Plate: 0 No Violation: 0 N/A

Uncontrollable Violations Rejected by Citation should have been issued but wasnt, not due to vendor. BPD by Reason and Location Multiple vehicles in image, info not found at MVA, etc. Non-Violations Rejected by BPD by Reason and Location DOT Voids - Total No violation occurred so canceled Total Citations Voided by DOT Total Voided Citations by Reason; Under Investigation (UI) codes: Stolen Vehicle (SV), Stolen Tags (ST), Owner Death (OD), Funeral Procession (FP), Bankruptcy (BR), Official Police Business (PD), Rental/Lease Exemptions (RE), Voided by DOT (VD) Funeral procession, second speed below threshold, etc.

Voids by Reason

See Attached Spreadsheet

See Attached Spreadsheet

See Attached Spreadsheet

See Attached Spreadsheet

MOIT/ DOT-IT

# of errors in daily data uploads from # of citations that failed to upload to MOITs mainframe per day # of discrepancies in data sets Dummy files during Test Run. Check every week. Problem in the past with openbaltimore data. between MOIT and iP360.

General Performance Metrics During Test Run


Metric Description Rejection Codes in iP360 match the PDF conversion of citations in iP360 is Citations are cast in stone; same in iP360 as print out. working properly iP360 is working properly Comments DOT verifies. DOT verifies. Latest Business Rules Not Yet Finalized Working with Printer to Ensure .PDFs are not being modified Vendor is working with BPD to address Closeout Log Issues. IP360 is working well during test phase at LC 2054. Brekford addressed initial issues with DOT Consultant Queues Latest Business Rules Not Yet Finalized Working with Printer to Ensure .PDFs are not being modified Vendor is working with BPD to address Closeout Log Issues. IP360 is working well during test phase at LC 2054. Latest Business Rules Not Yet Finalized Working with Printer to Ensure .PDFs are not being modified

Data is complete and accurate; new version (3.0) is working properly; able to handle test run; rolling right data is separated Vendor isn't making any changes to the data or purging any data. from straight through; separate test run data from real data Queues listed in Business Rules. BPD verifies.

Queues in iP360 are properly filled Reports are generated accurately

All reports are done properly and on time including the monthly DOT verifies. report in SHAs format.

Test run data is in Public iP360 domain Images and videos are accessible. Vendor Updated citation template is being used. All vendors SOPs are being properly followed. Processing rate is uniform. iCourt has documents as 1 PDF per case No major problems with dark shots, sun glare, time stamps, etc. No changes are made without DOT approval. All citations are mailed to DOT before the mail dates. iP360 to reflect data by the next morning.

Consultant will be on site to oversee vendors operations. No lopsided huge mass processing in one day. DOT verifies. DOT verifies. DOT verifies. Maintain proper communication with the client. Deliver to DOT by 13th day from violation date for in state, 29th DOT verifies. day for out of state. Glare of Plate is 2% of Cancellations

BPD

Officers are reviewing PDFs also. All City's SOPs are being properly Program is running error free There are no erroneous citations. Phony Trial Requests

Report problems/issues to DOT daily.

DOT

DOT will review all citations. Total # of phony trial requests created same as total # trial BRC will determine which citations to make trial requests for. requests received by DOT and vendor. Dummy files. Total # of phony payment, trial and flagging created is same as total # of trial, payment, and flagging data received by DOT and BRC will make up data to test data transfers. vendor. Dummy files. DOT-IT will download data from vendor to OnBase daily. Automated daily data transfer is occurring between Brekford, MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT DOT verifies. DOT-IT DOT-IT DOT-IT

BRC Phony payment, trial and flagging

MOIT/ DOT-IT

DOT Traffic can retrieve data in Payment, trial and flagging data is uploaded into iP360 daily Reports and data accessible in csv format Monthly report sent to DOT to check invoices, accessible on Mainframe also.

Additional Performance Metrics When We Go Live


Cases Dismissed Rate by Location DOT Cases Upheld Rate by Location Cases Dismissed Rate by Reason Total $ Collected from Paid Citations Total # of Delinquent Citations Total Trial Requests by Location Monitor citation status BRC Cases Dismissed by Location/Total Cases on Docket by Location Cases Upheld by Location/Total Cases on Docket by Location; gauge court outcomes by location. Cases Dismissed by Reason/Total Cases on Docket total $ collected from paid citations; separate speed and red light payments. Update monthly for CitiStat. Total value of unpaid citation fines; separate speed and red light. Update monthly for CitiStat. Total and Monthly basis for CitiStat. Total # of paid citations, unpaid (delinquent citations), flagged vehicles, trial requests by location, adjudication outcomes

BRC BRC BRC

Performance Metrics During Test Run


Metric Data Components (Description); Comments

Citation should have been issued but wasnt due to vendor. Controllable Cancellations by Vendor Equipment malfunction; not sent to BPD in time, etc. LC 2054 by Reason and Location only.

Vendor

Uncontrollable Cancellations by Vendor by Reason and Location

Citation should have been issued but wasnt, not due to vendor. Multiple vehicles in image, info not found at MVA, etc. LC 2054 only.

Non-Violations Canceled by Vendor by Reason and Location

No violation occurred so canceled. Funeral procession, second speed below threshold, etc. Only LC 2054 only.

7/15 -7/26/2013 Comments Total Violations - 1676 Clarity of Plate - 9% (51) (of all cancellations) Equipment Malfunction - 50% (291) Error Radar - 0% (1) Expired Violation - 1% (4) Dealer Tags Out of State - 1% (3) Glare on Plate - 2% (9) Government Tag - 1% (4) Multiple Vehicles - 3% (19) No Rear Plate - 2% (13) Not Found on MVA - 7% (39) Obstructed Vehicle/Plate - 8% (46) Other - 1% (3) Rental - 4% (26) Temp Tags (Out of State) - 1% (5) Vehicle Mismatch - 1% (4) Weather Condition - 1% (3) Emergency Response - 0% (1) No Violation - 7% (38) Test-Shot - 4% (21)

7/29-8/2/2013 Comments Total Violations- 532 Clarity of Plate - 3% (6) (of all cancellations) Equipment Malfunction - 71% (149) Error Radar - 4% (2) Glare on Plate - 6% (12) Multiple Vehicles - 2% (5) No Rear Plate - 1% (2) Not Found on MVA - 5% (11) Obstructed Vehilce/Plate - 2% (5) Rental - 2% (5)

8/5-8/9/2013 Comments Total Violations - 513 Clarity of Plate - 40% (39) (of all cancellations)

8/12-8/16/2013 Comments Total Violations - 569 Clarity of Plate - 29% (20) (of all cancellations)

Glare on Plate - 10% (10) Multiple Vehicles - 2% (2) No Rear Plate - 3% (3) Not Found on MVA - 7% (7) Obstructed Vehilce/Plate - 8% (8) Rental - 12% (12) Temp Tags(Out of State) - 2% (2) Vehicle Mismatch - 4% (4) Weather Condition - 3% (3)

Glare on Plate - 14% (10) Government Tags - 6% (4) Multiple Vehicles - 6% (4) No Rear Plate - 3% (2) Not Found on MVA - 13% (9) Obstructed Vehilce/Plate - 12% (8) Rental - 6% (4) Temp Tags(Out of State) - 1% (1) Vehicle Mismatch - 1% (1) Weather Condition - 3% (2)

Emergency Response - 0% (1) No Violation - 2% (4) Test-Shot - 4% (8) Total Violations: 532 Vendor Accepted: 280 Percent Accepted: 53% Vendor Cancellation: 230 Percent Canceled: 43% Still Processing: 22 Percent Still Processing: 4%

Emergency Response - 1% (1) No Violation - 2% (4) Test-Shot - 7% (7) Total Violations: 513 Vendor Accepted: 341 Percent Accepted: 66% Vendor Cancellation: 154 Percent Canceled: 30% Still Processing: 18 Percent Still Processing: 4%

Test-Shot - 6% (4)

Vendor Cancellation Rate

Total Violations: 1676 Vendor Accepted: 1012 Percent Accepted: 60% Vendor Cancellation: 582 Violations Canceled by Vendor/Total Violations captured should Percent Canceled: 35% be under 20%. Initial Analyst or 2nd Analyst cancels. Still Processing: 82 Percent Still Processing: 5%

Total Violations: 569 Vendor Accepted: 367 Percent Accepted: 64% Vendor Cancellation: 172 Percent Canceled: 30% Still Processing: 30 Percent Still Processing: 6%

# of times PCU was unable to setup properly # of times PCU was unable to close out properly BPD Rejection Rate

BPD Start Up Log Error: 3 BPD not able to log into camera, can't take test shot, or verify equipment is working properly. Brekford usually gets them working by the afternoon on same day. Camera shuts down prematurely during the day, can't take test BPD Close Out Log Error: 5 shot, etc. All events get discarded on a per camera per day basis. Vendor Accepts: 1012 Violations Rejected by BPD/Total Violations Accepted by BPD Rejects: 48 Vendor; should be under 10% Percent Reject: 5% Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc. LC 2054 only. Clarity of Plate: 25

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Close Out Log Error: 1

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

Vendor Accepts: 280 BPD Rejects: 4 Percent Rejected: 1% Clarity of Plate: 2 Dark Environment: 2

Vendor Accepts: 341 BPD Rejects: 34 Percent Rejected: 10% Clarity of Plate: 21

Vendor Accepts: 367 BPD Rejects: 18 Percent Rejected: 5% Clarity of Plate: 8 Dark Environment: 1 Incorrect Vehicle: 1 Glare of Plate: 1 Multiple Vehicles: 7

DOT

Controllable Violations Rejected by BPD by Reason and Location

Citation should have been issued but wasnt, not due to Uncontrollable Violations Rejected by vendor. Multiple vehicles in image, info not found at MVA, etc. BPD by Reason and Location LC 2054 only. Non-Violations Rejected by BPD by Reason and Location No violation occurred so canceled. Funeral procession, second speed below threshold, etc. LC 2054 only.

Glare of Plate: 5 Multiple Vehicles: 11 Obstructed Vehicle/Plate: 5 Stolen Plate: 1 No Violation: 1 None.

Glare of Plate: 3 Multiple Vehicles: 10

None.

None.

DOT Voids - Total

Total citations voided or recommended for voiding by DOT/URS.

Issues were noted with location of reference lines A few violations appeared to have early triggers moving. Also, some vehicles appearing to be out of Brekford to re-review. position (early triggers). Brekford re-reviewed and did cancellations when URS brought these issues to their attention.

A few images appear to be dark and/or clarity of plate URS noted that there were a few concerns with a concern - Brekford to reassess. clarity of plate. Brekford said they would rereview. Quantity of citations in queue remains inconsistent - only provided 46 on 8/14, no others provided.

Voids by Reason

Total Voided Citations by Reason; Under Investigation (UI) Not testing UI codes until September per DOT-IT. codes: Stolen Vehicle (SV), Stolen Tags (ST), Owner Death (OD), Funeral Procession (FP), Bankruptcy (BR), Official Police Business (PD), Rental/Lease Exemptions (RE), Voided by DOT (VD)

Not testing UI codes until September per DOT-IT.

Not testing UI codes until September per DOT-IT.

Not testing UI codes until September per DOT-IT.

MOIT/ DOT-IT

No files transferred in the 1st week. 2nd week data # of errors in daily data uploads from # of citations that failed to upload to MOITs mainframe per day showed errors in content and format Vendor. (bounced out). Vendor needs to resubmit those within 1 day. # of discrepancies in data sets between MOIT and iP360. Dummy files during Test Run. Check every week. Problem in the past with openbaltimore data. Not checked by DOT-IT.

343 citations had to be discarded in the test run because the batch of citation #s was incorrect. The problem has been corrected. 116 data transfer errors reported by MOIT. Not checked by DOT-IT.

All 116 citations rejected on 08/09/13. Unable to get updates for the rest of the week due to IT issues.

Unable to get updates all week due to IT issues. No data transfers.

Not checked by DOT-IT.

Not checked by DOT-IT.

Issues Monitored During Test Run


Metric Description; Comments Rejection Codes in iP360 match the DOT verifies. ones in the latest Business Rules. PDF conversion of citations in iP360 is Citations are cast in stone; same in iP360 as print out. DOT working properly verifies. Data is complete and accurate; new version (3.0) is working properly; able to handle test run; rolling right data is separated from straight through; separate test run data from real data. Vendor isn't making any changes to the data or purging any data. Latest Business Rules not yet finalized. URS using version provided 4/12/13. PDFs are not being modified. Vendor is working with BPD to address Closeout Log Issues. URS also experienced some issues with accessing iP360 and quantity of citations provided for review was inconsistent. Also, URS does not have access to violations cancelled by Brekford. Latest Business Rules not yet finalized. URS using version provided 4/12/13. PDFs are not being modified. Vendor is working with BPD to address Closeout Log Issues. There were issues identified with Brekford providing adequate access to URS for timely QC checks before BPD review. URS does not have access to violations canceled by Brekford. Latest Business Rules not yet finalized. URS using version provided 4/12/13. PDFs are not being modified. Issue of 1 voided citation that was found missing in ip360 came up. Vendor will investigate how many vendor voids are missing from ip360. This function will be DOT/BRC. Vendor will also look into capturing voids on ip360. URS does not have access to violations canceled by Brekford. Queues working properly. Latest Business Rules not yet finalized. URS using version provided 4/12/13. PDFs are not being modified. Brekford said data will not be purged anymore from iP360. No violations to review in iP360 for 2 days this week due to iP360 program issues (resolved by Brekford on 08/14/13). URS does not have access to violations canceled by Brekford.

iP360 is working properly

Queues in iP360 are properly filled Reports are generated accurately Updated citation template is being used. Vendor All vendors SOPs are being properly followed.

Queues listed in Business Rules. BPD verifies. All reports are done properly and on time including the monthly report in SHAs format. DOT verifies.

Problems with BPD Supervisor Queue to view rejected violations. N/A Not approved yet. Using previous template. No. Vendor changed camera alignment during maintenance work. This caused misalignment in the report lines and camera shut-down on 7/25/13 afternoon. DOT has informed vendor to re-verify all camera settings after all maintenance activities on the camera in accordance to the established SOP.

Brekford addressed initial issues with URS Queues.

Queues working properly.

No report submitted by Brekford. Not approved yet. Using previous template. No issues reported

No report submitted by Brekford. Not approved yet. Using previous template. No issues reported

No report submitted by Brekford. Not approved yet. Using previous template. No issues reported

Consultant on site to oversee vendors operations.

Processing rate is uniform. iCourt has documents as 1 PDF per case No changes are made without DOT approval.

No lopsided huge mass processing in one day. DOT verifies. DOT verifies.

No issues reported. N/A yet. Brekford has been communicating better with DOT.

No issues reported. N/A yet. Brekford has been communicating better with DOT.

No issues reported. N/A yet. No issues reported. However, issue of 1 voided citation that was found missing in ip360 came up. Vendor will investigate how many vendor voids are missing from ip360. Delay due to invoice. Delivered to DOT on 08/22/13.

Quantity of violations in queues are inconsistent. N/A yet. No issues reported. However, issue of 1 voided citation that was found missing in ip360 came up. Vendor will investigate how many vendor voids are missing from ip360. Delay due to invoice. Delivered to DOT on 08/22/13.

Maintain proper communication with the client.

Complied. All citations are mailed to DOT before Deliver to DOT by 13th day from violation date for in state, 29th the mail dates. iP360 to reflect data day for out of state. DOT verifies. by the next morning. All City's SOPs are being properly followed. Yes. Need to update the Business Rules. Problems with closing down cameras several times (violations discarded those days); problem setting up one camera on 3 different days (Brekford setup in afternoon); access problems in iP360; URS noticed reference lines moving and some early triggers; other data transfer issues were reported by IT; high cancellation rate.

Delay due to invoice. Delivered to DOT on 08/22/13.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules. iP360 not working properly for 2 days this week, problem resolved on 08/14/13; quantity of citations in queue is inconsistent; high cancellation rate; some #'s appear to be changing in iP360 such as BPD rejections.

Is ATVES Program running error free Note any significant issues. DOT

Some issues with clarity of images; data transfer Problem with closing down camera one day violations discarded; 343 citations (4 days worth) had issues were reported by IT; high cancellation rate. to be discarded since they failed to transfer to City's mainframe due to citation #'s being incorrect; there were some more violations with early triggers; reference lines still not fixed (Brekford is welding brackets to trays (all PCUs) to stabilize the trays); high cancellation rate.

There are no erroneous citations.

A % of violations will be reviewed by URS in iP360 before they go to BPD. All printed citations will be reviewed by DOT during Test Run.

No erroneous citations out of the 53 reviewed except as noted for citation 19997493, speed reading looks questionable.

Phony Trial Requests BRC Phony payment, trial and flagging

Total # of phony trial requests created same as total # trial requests received by DOT and vendor. Dummy files. BRC will determine which citations to make trial requests for.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Total # of phony payment, trial and flagging created is same as Not testing per DOT-IT. total # of trial, payment, and flagging data received by DOT and vendor. Dummy files. BRC will make up data to test data transfers.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

DOT Traffic can retrieve data in OnBase Payment, trial and flagging data is uploaded into iP360 daily Reports and data accessible in csv format Monthly report sent to DOT to check invoices, accessible on Mainframe also.

DOT-IT will upload data from vendor to OnBase daily. DOT verifies. Automated daily data transfer is occurring between Brekford, MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

MOIT/ DOT-IT

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Other Performance Metrics When We Go Live


Cases Dismissed Rate Overall and by Location Cases Upheld Rate Overall and by Location Cases Dismissed Rate Overall and by Reason Monthly Reports Generated from Data in System Total $ Collected from Paid Citations Total # of Delinquent Citations Total Trial Requests by Location Monitor citation status Cases Dismissed by Location/Total Cases on Docket by Location Cases Upheld by Location/Total Cases on Docket by Location; gauge court outcomes by location. Cases Dismissed by Reason/Total Cases on Docket Payment Reports, Flagged Vehicles, Trial Requests, Trial Disposition, Unpaid Citations, Summary Report total $ collected from paid citations; separate speed and red light payments. Update monthly for CitiStat. Total value of unpaid citation fines; separate speed and red light. Update monthly for CitiStat. Total and Monthly basis for CitiStat. Total # of paid citations, unpaid (delinquent citations), flagged vehicles, trial requests by location, adjudication outcomes N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run.

DOT

DOT-IT

BRC BRC BRC BRC

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

Violation Date Total Violations Brekford Processing Brekford Accepted Brekford Cancels Client Processing Client Accepted Client Rejected Print Queue Printed 8/1/2013 105 8 37 60 1 36 0 0 36 8/2/2013 86 3 66 17 0 64 2 0 64 8/5/2013 73 4 56 13 1 51 4 11 40 8/6/2013 129 4 56 69 3 40 13 3 37 8/7/2013 103 4 65 34 0 63 2 0 63 8/8/2013 85 4 65 16 0 59 6 0 59 8/9/2013 123 2 99 22 0 90 9 17 73 8/12/2013 89 0 0 89 0 0 0 0 0 8/13/2013 109 7 85 17 0 78 7 0 78 8/14/2013 134 11 98 25 28 67 3 0 67 8/15/2013 110 3 82 25 82 0 0 0 0 8/16/2013 127 9 102 16 102 0 0 0 0 8/19/2013 85 6 67 12 67 0 0 0 0 8/20/2013 111 11 80 20 80 0 0 0 0 8/21/2013 116 6 97 13 97 0 0 0 0 8/22/2013 99 77 2 20 2 0 0 0 0 8/23/2013 108 94 3 11 0 0 0 0 0

Processing Status August 2013

140 120 100 Client Rejected Axis Title 80 60 40 20 0 Print Queue Brekford Processing Printed Client Accepted

Totals

1792

253

1060

479

463

548

46

31

517

Client Processing Brekford Cancels Brekford Accepted Total Violations

Cancellation Reason Clarity of Tag Dealer Tags Out of State Emergency Response Equipment Malfunction Error Radar Expired Violation Glare of Plate Government Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot Vehicle Mismatch Weather Condition

Date Total 8/1/2013

Date Total 8/2/2013

Date Total 8/5/2013

Date Total 8/6/2013 8/6/2013

5 1

Date Total 8/7/2013

26

Date Total 8/8/2013

Date Total 8/9/2013

Date 4 0 0

Total

Date Total 8/13/2013

Date Total 8/14/2013

Total 8 0 8/15/2013 7

Date Total 8/16/2013

Date Total 8/19/2013 8/19/2013

Date Total 4 8/20/2013 1 0 0 8/20/2013 8/20/2013 0 8/20/2013 0 4 8/20/2013 2 8/20/2013 1 8/20/2013 0

Date Total 7 8/21/2013

Date Total 1 8/22/2013 8/22/2013

Date Total 9 8/23/2013 1 8/23/2013 0 3 1 0 8/23/2013 1 8/23/2013 0 4 8/23/2013 0 1 8/23/2013

3 1 0 0 2 1 0 3 0 1

8/1/2013

53 0 0 8/2/2013 0 8/2/2013 1 0 0 1 0 1 0 0 0 0

0 0 0 0 0 0 0 1 1 2 1 1 7

0 4 8/21/2013 1 8/21/2013 1 0 1 8/21/2013 4 8/21/2013 2 8/21/2013 0 8/21/2013

0 8/22/2013 4 8/22/2013 1 8/22/2013 0 0 8/22/2013 2 2 8/22/2013 1 2 8/22/2013

8/6/2013

5 0 0 0 2 1 1 0 2 2 19

8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013

0 0 1 1 1 1 2 1 1 34

8/9/2013 8/8/2013 8/8/2013 1 1 0 0 4 4 0 2 0 1 16

5 8/13/2013 0 1 0 8/12/2013 3 1 0 3 2 1 2 22 1 0 1 0 6 0 3 0 8/13/2013 2 17

8/14/2013 8/14/2013 8/14/2013

8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013

8/13/2013 89 8/13/2013

8/1/2013

8/1/2013 8/1/2013

0 0 0 0 0 0 0

8/2/2013 8/2/2013

8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013

8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013

8/8/2013 8/8/2013 8/8/2013 8/8/2013

8/14/2013 8/14/2013 8/14/2013 8/14/2013

4 1 1 0 0 5 4 1 1 0 25

8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013

3 1 2 1 3 4 1 2 1 25

8/16/2013 8/16/2013 8/16/2013

4 1 1

8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013

1 1 4 1 1

8/19/2013 8/19/2013 8/19/2013

8/13/2013

8/2/2013

53

16

12

20

13

20

11

Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Sum

85 0 4 53 0 0 33 7 9 8 89 30 32 0 25 3 15 5 5 403

Cancellation Reason 8/1/2013 - 8/23/2013


Vehicle Mismatch 1% Temp Tags (Out of State) 1% Test-Shot 4% Weather Condition 1%

8/5/2013 - 8/9/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

39 0 0 0

40% 0% 0% 0%

8/12/2013 - 8/16/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

21 0 0 0

12% 0% 0% 0%

8/19/2013 - 8/23/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

24 0 0 0

32% 0% 0% 0%

Other 0%

Rental 6%

Emergency Response No Violation Test-Shot


Clarity of Tag 21%

1 0 7

1% 0% 7%

Emergency Response No Violation Test-Shot

0 89 4

0% 52% 2%

Emergency Response No Violation Test-Shot

3 0 4

4% 0% 5%

Obstructed Vehicle/Plate 8% Dealer Tags Out of State 0% Emergency Response 1%

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plat Other Rental Temp Tags (Out of State Vehicle Mismatch Weather Condition

0 10 0 2 3 7 8 0 12 2 4 3 98

0% 10% 0% 2% 3% 7% 8% 0% 12% 2% 4% 3% 98

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plat Other Rental Temp Tags (Out of State Vehicle Mismatch Weather Condition

0 11 4 4 2 15 9 0 9 1 1 2 172

0% 6% 2% 2% 1% 9% 5% 0% 5% 1% 1% 1%

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Vehicle Mismatch Weather Condition

0 11 3 3 2 7 15 0 4 0 0 0 76

0% 14% 4% 4% 3% 9% 20% 0% 5% 0% 0% 0%

Not Found on MVA 7%

Equipment Malfunction 13%

Error Radar 0% No Violation 22% Glare of Plate 8% Expired Violation 0%

Multiple Vehicles 2% No Rear Plate 2%

Government Tag 2%

Violation Reason Clarity of Tag Glare of Plate No Rear Plate Not Found on MVA

Date Total 8/2/2013 8/2/2013 8/2/2013 8/2/2013

1 1 1 1

Cancellation Reason
1.2 1 0.8 0.6 0.4 0.2 0 8/2/2013 Clarity of Tag Glare of Plate No Rear Plate Not Found on MVA Not Found on MVA 25% No Rear Plate 25% Clarity of Tag 25%

Cancellation Reason 8/2/2013

Glare of Plate 25%

Cancellation Reason Clarity of Tag Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013

1 1 1 2 1 1

Cancellation Reason 8/5/2013

Cancellation Reason
2.5

Vehicle Mismatch 14%

Clarity of Tag 15%

Test-Shot 14% 2 Clarity of Tag 1.5 Not Found on MVA Obstructed Vehicle/Plate 1 Rental Test-Shot Vehicle Mismatch 0.5 Rental 29%

Not Found on MVA 14% Obstructed Vehicle/Plate 14%

0 8/5/2013

Cancellation Reason Clarity of Tag Emergency Response Glare of Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013

5 1 5 2 1 1 2 2 19

Cancellation Reason
6 5 4 3 2 1 0 8/6/2013 Obstructed Vehicle/Plate 5% Clarity of Tag Emergency Response Glare of Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/6/2013

Vehicle Mismatch 11% Test-Shot 11% Rental 5% Emergency Response 5% Not Found on MVA 11% Clarity of Tag 26%

Glare of Plate 26%

Cancellation Reason Clarity of Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013

26 1 1 1 1 2 1 1 34

Cancellation Reason
30 25 20 15 10 Clarity of Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch 8/7/2013

Cancellation Reason 8/7/2013


Test-Shot 3% Obstructed Vehicle/Plate 3% Not Found on MVA 3% No Rear Plate 3% Multiple Vehicles 3% Vehicle Mismatch 3%

5 0

Rental 6%

Clarity of Tag 76%

Cancellation Reason Date Total Clarity of Tag 8/8/2013 Multiple Vehicles 8/8/2013 No Rear Plate 8/8/2013 Obstructed Vehicle/Plate 8/8/2013 Rental 8/8/2013 Test-Shot 8/8/2013 Weather Condition 8/8/2013

3 1 1 4 4 2 1 16
4.5

Cancellation Rreason Cancellation Reason 8/8/2013


Weather Condition 6% 4 3.5 3 2.5 2 1.5 Test-Shot 13% Clarity of Tag 19% Multiple Vehicles 6% No Rear Plate 6% Rental 25% Obstructed Vehicle/Plate 25% 1 0.5 0 8/8/2013 Clarity of Tag Multiple Vehicles No Rear Plate Obstructed Vehicle/Plate Rental Test-Shot Weather Condition

Cancellation Reason Clarity of Tag Glare of Plate No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot Weather Condition

Date Total 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013

4 5 1 3 1 3 2 1 2 22

Cancellation Reason
6

5 Clarity of Tag 4 Glare of Plate No Rear Plate Not Found on MVA 3 Obstructed Vehicle/Plate Rental 2 Temp Tags (Out of State) Test-Shot 1 Weather Condition

0 8/9/2013

Cancellation Reason 8/9/2013

Weather Condition 9% Test-Shot 5% Clarity of Tag 18%

Temp Tags (Out of State) 9%

581
Rental 14% Glare of Plate 23%

Obstructed Vehicle/Plate 4%

Not Found on MVA 14%

No Rear Plate 4%

Cancellation Reason Clarity of Tag Government Tag No Rear Plate Not Found on MVA Rental Weather Condition

Date Total 8/13/2013 8/13/2013 8/13/2013 8/13/2013 8/13/2013 8/13/2013

4 1 1 6 3 2 17

Cancellation Reason
7 6 5 4 Clarity of Tag Government Tag No Rear Plate Not Found on MVA Rental Weather Condition

Cancellation Reason 8/13/2013

3 2 1

Weather Condition 12% Rental 18%

0 Clarity of Tag 23% 8/13/2013

Government Tag 6%

Not Found on MVA 35%

No Rear Plate 6%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicle Obstructed Vehicle/Plate Test-Shot NotFound on MVA Rental

Date Total 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013

8 4 1 1 4 1 5 1 25

Cancellation Reason
9 8 7 6 5 4 3 2 1 0 8/14/2013 Clarity of Tag Glare of Plate Government Tag Multiple Vehicle Obstructed Vehicle/Plate Test-Shot NotFound on MVA Rental

Cancellation Reason 8/14/2013


Rental 4%

NotFound on MVA 20% Test-Shot 4% Obstructed Vehicle/Plate 16%

Clarity of Tag 32%

Glare of Plate 16%

Multiple Vehicle 4%

Government Tag 4%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicle No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013

7 3 1 2 1 3 4 1 2 1

Cancellation Reason
8 7 6 5 4 3 Clarity of Tag Glare of Plate Government Tag Multiple Vehicle No Rear Plate Not Found on MVA Obstructed Vehicle/Plate

25

2 1 0 8/15/2013

Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/15/2013


Vehicle Mismatch 4%

Test-Shot 8% Rental 4%

Clarity of Tag 28%

Obstructed Vehicle/Plate 16%

Glare of Plate 12% Not Found on MVA 12%

Multiple Vehicle 8% No Rear Plate 4%

Government Tag 4%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Temp Tags (Out of State) Test-Shot Not Found on MVA Obstructed Vehicle/Plate Rental

Date Total 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013

2 4 1 1 1 1 1 1 4 16

Cancellation Reason
5 4 4 3 3 2 2 1 1 0 Clarity of Tag 13% 1/1/1900 Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Temp Tags (Out of State) Test-Shot Not Found on MVA Obstructed Vehicle/Plate Rental

Cancellation Reason 8/16/2013

Rental 25%

Obstructed Vehicle/Plate 6%

Glare of Plate 25%

Not Found on MVA 6% Test-Shot 6% Multiple Vehicles 6% Governmen t Tag 7%

Temp Tags (Out of State) 6%

Violation Reason Clarity of Tag Emergency Response Not Found on MVA Obstructed Vehicle/Plate Rental

Date Total 8/19/2013 8/19/2013 8/19/2013 8/19/2013 8/19/2013

4 1 4 2 1 12

Cancellation Reason
4.5 4 3.5 3 2.5 2 1.5 1 0.5 Rental 8% 0 8/19/2013 Clarity of Tag Emergency Response Not Found on MVA Obstructed Vehicle/Plate Rental

Cancellation Reason 8/19/2013

Obstructed Vehicle/Plate 17%

Clarity of Tag 34%

Not Found on MVA 33%

Emergency Response 8%

Violation Reason Date Total Clarity of Tag 8/20/2013 Glare of Plate 8/20/2013 Government Tag 8/20/2013 Multiple Vehicles 8/20/2013 Not Found on MVA 8/20/2013 Obstructed Vehicle/P 8/20/2013 Rental 8/20/2013

7 4 1 1 1 4 2 20

Cancellation Reason
8 7 6 5 4 3 2 1 Rental 10% 0 8/20/2013 Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Rental

Cancellation Reason 8/20/2013

Obstructed Vehicle/Plate 20%

Clarity of Tag 35%

Not Found on MVA 5% Multiple Vehicles 5% Government Tag 5% Glare of Plate 20%

Violation Reason Clarity of Tag Glare of Plate Government Tag Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Date Total 8/21/2013 8/21/2013 8/21/2013 8/21/2013 8/21/2013 8/21/2013 8/21/2013

1 5 1 2 2 1 2 14

Cancellation Reason
6 5 4 Clarity of Tag Glare of Plate Government Tag 3 2 Clarity of Tag 7% 1 0 8/21/2013 Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Cancellation Reason 8/21/2013

Test-Shot 14% Rental 7%

Obstructed Vehicle/Plate 14%

Glare of Plate 36%

Not Found on MVA 15%

Government Tag 7%

Violation Reason Date Total Clarity of Tag 8/22/2013 Emergency Response 8/22/2013 Expired Date from MVA 8/22/2013 Glare of Plate 8/22/2013 Government Tag 8/22/2013 No Rear Plate 8/22/2013 Not Found on MVA 8/22/2013 Obstructed Vehicle/Plate 8/22/2013 Other 8/22/2013 Test-Shot 8/22/2013 Vehicle Mismatch 8/22/2013

17 1 1 3 1 1 5 4 2 1 1 36

Cancellation Reason
18 Clarity of Tag 16 14 12 10 8 6 4 2 Emergency Response Expired Date from MVA Glare of Plate Government Tag No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Test-Shot 41508 Vehicle Mismatch

Cancellation Reason 8/22/2013


Test-Shot Vehicle Mismatch 3% 3%

Other 5%

Obstructed Vehicle/Plate 11% Clarity of Tag 46% Not Found on MVA 13%

No Rear Plate 3% Government Tag 3%

Glare of Plate 8% Emergency Expired Date from MVA Response 3% 2%

Violation Reason Date Total Clarity of Tag 8/23/2013 Emergency Response 8/23/2013 Multiple Vehicles 8/23/2013 No Rear Plate 8/23/2013 Not Found on MVA 8/23/2013 Obstructed Vehicle/Plate8/23/2013 Rental 8/23/2013 Test-Shot 8/23/2013

3 1 2 1 4 3 1 1 16

Cancellation Reason
4.5 4 3.5 3 2.5 2 Clarity of Tag Emergency Response Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot 8/23/2013 Clarity of Tag 19% Emergency Response 6% Multiple Vehicles 13%

Cancellation Reason 8/23/2013


Test-Shot 6%

1.5 1 0.5 0

Rental 6%

Obstructed Vehicle/Plate 19%

Not Found on MVA 25% No Rear Plate 6%

Violation Reason Clarity of Tag Emergency Response Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot

Date Total 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013

11 1 3 2 4 1 2 1 1 1 27

Cancellation Reason
12 10 8 6 4 2 0 41512 Clarity of Tag Emergency Response Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State)

Cancellation Reason 8/26/2013


Temp Tags (Out of State) 4% Rental 4% Test-Shot 4%

Obstructed Vehicle/Plate 4%

Other 7% Clarity of Tag 41% Not Found on MVA 15%

Multiple Vehicles 7% Glare of Plate 11%

Emergency Response 3%

Violation Reason Date Total Clarity of Tag 8/27/2013 Glare of Plate 8/27/2013 No Rear Plate 8/27/2013 Not Found on MVA 8/27/2013 Obstructed Vehicle/Plate 8/27/2013 Test-Shot 8/27/2013 Weather Condition 8/27/2013

3 3 1 3 3 1 2 16

Cancellation Reason
3.5 3 2.5 2 1.5 1 0.5 0 8/27/2013 Clarity of Tag Glare of Plate No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Test-Shot Weather Condition

Cancellation Reason 8/27/2013

Test-Shot 6%

Weather Condition 12%

Clarity of Tag 19%

Obstructed Vehicle/Plate 19%

Glare of Plate 19%

Not Found on MVA 19%

No Rear Plate 6%

Violation Reason Clarity of Tag No Rear Plate Rental

Date Total 8/28/2013 8/28/2013 8/28/2013

6 1 1 8

Cancellation Reason
7 6 5

Cancellation Reason 8/28/2013


Rental 13%

4 3 2 1 0 41514

Clarity of Tag No Rear Plate Rental

No Rear Plate 12%

Clarity of Tag 75%

Violation Reason Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Date Total 8/29/2013 8/29/2013 8/29/2013 8/29/2013

3 1 1 1

Cancellation Reason Cancellation Reason 8/29/2013


3.5 3 2.5 2 Test-Shot 17% 1.5 1 0.5 Rental 17% Not Found on MVA 50% 0 8/29/2013 Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Obstructed Vehicle/Plate 16%

Violation Reason Clarity of Tag Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/30/2013 8/30/2013 8/30/2013 8/30/2013 8/30/2013 8/300/2013 8/30/2013 8/30/2013

8 1 1 5 2 1 1 1 20

Cancellation Reason
9 8 7 6 5 4 3 2 1 0 8/30/2013 Clarity of Tag Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/30/2013


Test-Shot Vehicle Mismatch 5% 5%

Rental 5% Obstructed Vehicle/Plate 10%

Clarity of Tag 40%

Not Found on MVA 25%

Multiple Vehicles 5%

Glare of Plate 5%

Performance Metrics During Test Run


Metric Data Components (Description); Comments

Citation should have been issued but wasnt due to vendor. Controllable Cancellations by Vendor Equipment malfunction; not sent to BPD in time, etc. LC 2054 by Reason and Location only.

7/15 -7/26/2013 Comments Total Violations - 1676 Clarity of Plate - 9% (51) Equipment Malfunction - 50% (291) Error Radar - 0% (1) Expired Violation - 1% (4)

7/29-8/2/2013 Comments Total Violations- 532 Clarity of Plate - 2% (5) Equipment Malfunction - 65% (149) Error Radar - 3% (6)

8/5-8/9/2013 Comments Total Violations - 513 Clarity of Plate - 25% (39)

8/12-8/16/2013 Comments Total Violations - 569 Clarity of Plate - 12% (21)

Vendor

Dealer Tags Out of State - 1% (3) Glare of Plate - 2% (9) Government Tag - 1% (4) Multiple Vehicles - 3% (19) No Rear Plate - 2% (13) Citation should have been issued but wasnt, not due to vendor. Uncontrollable Cancellations by Not Found on MVA - 7% (39) Multiple vehicles in image, info not found at MVA, etc. LC 2054 Vendor by Reason and Location Obstructed Vehicle/Plate - 8% (46) only. Other - 1% (3) Rental - 4% (26) Temp Tags (Out of State) - 1% (5) Vehicle Mismatch - 1% (4) Weather Condition - 1% (3) Emergency Response - 0% (1) Non-Violations Canceled by Vendor by No violation occurred so canceled. Funeral procession, second No Violation - 7% (38) Reason and Location speed below threshold, etc. Only LC 2054 only. Test-Shot - 4% (21) Total Violations: 1676 Vendor Accepted: 1012 Percent Accepted: 60% Violations Canceled by Vendor/Total Violations captured should Vendor Cancellation: 582 be under 20%. Initial Analyst or 2nd Analyst cancels. Percent Canceled: 35% Still Processing: 82 Percent Still Processing: 5% BPD not able to log into camera, can't take test shot, or verify BPD Start Up Log Error: 1 equipment is working properly. Brekford usually gets them working by the afternoon on same day. Camera shuts down prematurely during the day, can't take test BPD Close Out Log Error: 5 shot, etc. All events get discarded on a per camera per day basis. Vendor Accepts: 1012 Violations Rejected by BPD/Total Violations Accepted by BPD Rejects: 48 Vendor; should be under 10% Percent Reject: 5% Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc. LC 2054 only. Clarity of Plate: 25

Glare of Plate - 7% (16) Government Tags - 1% (3) Multiple Vehicles - 2% (5) No Rear Plate - 1% (3) Not Found on MVA - 5% (12) Obstructed Vehilce/Plate - 3% (7) Rental - 2% (5) Temp Tags (Out of State) - 05 (1) Vehicle Mismatch - 0% (1)

Glare of Plate - 8% (13) Multiple Vehicles - 1% (2) No Rear Plate - 2% (3) Not Found on MVA - 5% (7) Obstructed Vehilce/Plate - 6% (9) Rental - 18% (13) Temp Tags(Out of State) - 1% (2) Vehicle Mismatch - 3% (4) Weather Condition - 2% (3)

Glare of Plate - 6% (11) Government Tags - 2% (4) Multiple Vehicles - 2% (4) No Rear Plate - 1% (2) Not Found on MVA - 9% (15) Obstructed Vehilce/Plate - 5% (9) Rental - 4% (9) Temp Tags(Out of State) - 1% (1) Vehicle Mismatch - 1% (1) Weather Condition - 1% (2)

No Violation - 3% (7) Test-Shot - 4% (10)

Emergency Response - 1% (1) No Violation - 32% (50) Test-Shot - 5% (8) Total Violations: 513 Vendor Accepted: 341 Percent Accepted: 66% Vendor Cancellation: 154 Percent Canceled: 30% Still Processing: 18 Percent Still Processing: 4% BPD Start Up Log Error: 0

No Violation - 89% (52) Test-Shot - 2% (4)

Vendor Cancellation Rate

# of times PCU was unable to setup properly # of times PCU was unable to close out properly BPD Rejection Rate

Total Violations: 532 Vendor Accepted: 280 Percent Accepted: 53% Vendor Cancellation: 230 Percent Canceled: 43% Still Processing: 22 Percent Still Processing: 4% BPD Start Up Log Error: 0

Total Violations: 569 Vendor Accepted: 367 Percent Accepted: 64% Vendor Cancellation: 172 Percent Canceled: 30% Still Processing: 30 Percent Still Processing: 6% BPD Start Up Log Error: 0

BPD Close Out Log Error: 1

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

Vendor Accepts: 280 BPD Rejects: 4 Percent Rejected: 1% Clarity of Plate: 2 Dark Environment: 2

Vendor Accepts: 341 BPD Rejects: 33 Percent Rejected: 10% Clarity of Plate: 20

Vendor Accepts: 367 BPD Rejects: 10 Percent Rejected: 3% Clarity of Plate: 5

Controllable Violations Rejected by BPD by Reason and Location DOT

Glare of Plate: 5 Citation should have been issued but wasnt, not due to vendor. Multiple Vehicles: 11 Uncontrollable Violations Rejected by Multiple vehicles in image, info not found at MVA, etc. LC 2054 Obstructed Vehicle/Plate: 5 BPD by Reason and Location only. Stolen Plate: 1 Non-Violations Rejected by BPD by Reason and Location No violation occurred so canceled. Funeral procession, second speed below threshold, etc. LC 2054 only. No Violation: 1 URS unable to void citations, however issues were noted with location of refrence lines moving and vehicles appearing to be out of position. URS also experienced some issues with accessing iP360 and quantity of citations provided for review was inconsistent. Lastly, URS does not have access to violations cancelled by Brekford. URS unable to void citations. A few violations appeared to have early triggers - Brekford to rereview. It was noted that the radar readings were consistently different between 0.2 and 0.3 mph from the two cameras.

Glare of Plate: 3 Multiple Vehicles: 10

Glare of Plate: 1 Multiple Vehicles: 4

URS unable to void ciations. URS noted that they still do not have access to violations cancelled by Brekford. A few images appear to be dark and/or clarity of plate a concern - Brekford to reassess.

DOT Voids - Total

Total Citations Voided by DOT/URS

URS unable to void citations. Did note that there were a few concerns with clarity of plate. Brekford said they would re-review. Quantitiy of citations in queue remain inconsistent - only provided 46 on 8/14, no others provided. Still no access to Brekford cancelled violations

Voids by Reason

Total Voided Citations by Reason; Under Investigation (UI) Not testing UI codes per DOT-IT. codes: Stolen Vehicle (SV), Stolen Tags (ST), Owner Death (OD), Funeral Procession (FP), Bankruptcy (BR), Official Police Business (PD), Rental/Lease Exemptions (RE), Voided by DOT (VD)

Not testing UI codes per DOT-IT.

Not testing UI codes per DOT-IT.

Not testing UI codes per DOT-IT.

MOIT/ DOT-IT

No files transferred in the 1st week. 2nd week data # of errors in daily data uploads from # of citations that failed to upload to MOITs mainframe per day showed errors in content and format Vendor. (bounced out). Vendor needs to resubmit those within 1 day.

343 citations had to be discarded in the test run because the batch of citation #s was incorrect. The problem has been corrected.

All 116 citations rejected on 08/09/13. Unable to get updates for the rest of the week.

Unable to get updates

DOT IT

# of discrepancies in data sets between MOIT and iP360.

Dummy files during Test Run. Check every week. Problem in the Not checked by DOT-IT. past with openbaltimore data.

Not checked by DOT-IT.

Not checked by DOT-IT.

Not checked by DOT-IT.

Issues Monitored During Test Run


Metric Description; Comments Rejection Codes in iP360 match the DOT verifies. ones in the latest Business Rules. PDF conversion of citations in iP360 is Citations are cast in stone; same in iP360 as print out. DOT working properly verifies. Latest Business Rules not yet finalized. URS using draft Latest Business Rules not yet finalized. URS using draft version provided 4/12/13. version provided 4/12/13. Working with Printer to Ensure .PDFs are not being Working with Printer to Ensure .PDFs are not being modified modified Latest Business Rules not yet finalized. URS using draft version provided 4/12/13. Working with Printer to Ensure .PDFs are not being modified Latest Business Rules not yet finalized. URS using draft version provided 4/12/13. Working with Printer to Ensure .PDFs are not being modified

iP360 is working properly

Data is complete and accurate; new version (3.0) is working properly; able to handle test run; rolling right data is separated from straight through; separate test run data from real data. Vendor isn't making any changes to the data or purging any data. Queues listed in Business Rules. BPD verifies.

Vendor is working with BPD to address Closeout Log Issues. There were issues identified with Brekford providing adequate access to URS for timely QC checks before BPD review.

Vendor is working with BPD to address Closeout Log Issues. There were issues identified with Brekford providing adequate access to URS for timely QC checks before BPD review. Brekford addressed initial issues with URS Queues. No report submitted by Brekford. Not approved yet. Using previous template.

Queues in iP360 are properly filled Reports are generated accurately Updated citation template is being used. Vendor All vendors SOPs are being properly followed.

Problems with BPD Supervisor Queue to view rejected violations. All reports are done properly and on time including the monthly N/A report in SHAs format. DOT verifies. Not approved yet. Using previous template.

Issue of 1 voided citation that was found missing in ip360 came up. Vendor will investigate how many vendor voids are missing from ip360. This function will be DOT/BRC. Vendor will also look into capturing voids on ip360. Queues working properly. No report submitted by Brekford. Not approved yet. Using previous template. No issues reported

Brekford said data will not be purged anymore from iP360. No violations to review in iP360 for 2 days this week due to iP360 program issues. Resolved by Brekford on 08/14/13. Queues working properly. No report submitted by Brekford. Not approved yet. Using previous template. No issues reported

Consultant on site to oversee vendors operations.

No. Vendor changed camera alignment during No issues reported maintenance work. This caused misalignment in the report lines and camera shut-down on 7/25/13 afternoon. DOT has informed vendor to re-verify all camera settings after all maintenance activities on the camera in accordance to the established SOP. No issues reported. N/A yet. Brekford has been communicating better with DOT. No issues reported. N/A yet. Brekford has been communicating better with DOT.

Processing rate is uniform. iCourt has documents as 1 PDF per case No changes are made without DOT approval.

No lopsided huge mass processing in one day. DOT verifies. DOT verifies.

No issues reported. N/A yet. No issues reported. However, issue of 1 voided citation that was found missing in ip360 came up. Vendor will investigate how many vendor voids are missing from ip360. Delay due to invoice. Delivered to DOT on 08/22/13.

No issues reported. N/A yet. No issues reported. However, issue of 1 voided citation that was found missing in ip360 came up. Vendor will investigate how many vendor voids are missing from ip360. Delay due to invoice. Delivered to DOT on 08/22/13.

Maintain proper communication with the client. Delay due to invoice. Delivered to DOT on 08/22/13.

Complied. All citations are mailed to DOT before Deliver to DOT by 13th day from violation date for in state, 29th the mail dates. iP360 to reflect data day for out of state. DOT verifies. by the next morning. All City's SOPs are being properly followed. Yes. Need to update the Business Rules. Problems with closing down cameras several times. Violations discarded those days. Problem setting up one camera on 3 different days. Brekford setup in afternoon. Other data transfer issues were reported by IT. A % of violations will be reviewed by URS in iP360 before they go to BPD. All printed citations will be reviewed by DOT during Test Run. No erroneous citations out of the 53 reviewed except as noted for citation 19997493, speed reading looks inaccurate.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules. iP360 not working properly for 2 days this week. Problem resolved on 08/14/13.

Program is running error free DOT

Problem with closing down camera one day. Violations Data transfer issues were reported by IT. discarded. Also, 343 citations (4 days worth) had to be discarded since they failed to transfer to City's mainframe due to citation #'s being incorrect.

There are no erroneous citations.

Phony Trial Requests BRC Phony payment, trial and flagging

Total # of phony trial requests created same as total # trial requests received by DOT and vendor. Dummy files. BRC will determine which citations to make trial requests for.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Total # of phony payment, trial and flagging created is same as Not testing per DOT-IT. total # of trial, payment, and flagging data received by DOT and vendor. Dummy files. BRC will make up data to test data transfers. DOT-IT will upload data from vendor to OnBase daily. DOT verifies. Automated daily data transfer is occurring between Brekford, MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT Not uploaded yet. Not testing. Yes. Not testing.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

MOIT/ DOT-IT

DOT Traffic can retrieve data in OnBase Payment, trial and flagging data is uploaded into iP360 daily Reports and data accessible in csv format Monthly report sent to DOT to check invoices, accessible on Mainframe also.

Not uploaded yet. Not testing. Yes. Not testing.

Not uploaded yet. Not testing. Yes. Not testing.

Not uploaded yet. Not testing. Yes. Not testing.

Other Performance Metrics When We Go Live


Cases Dismissed Rate Overall and by Location Cases Upheld Rate Overall and by Location Cases Dismissed Rate Overall and by Reason Monthly Reports Generated from Data in System Total $ Collected from Paid Citations Total # of Delinquent Citations Total Trial Requests by Location Monitor citation status Cases Dismissed by Location/Total Cases on Docket by Location Cases Upheld by Location/Total Cases on Docket by Location; gauge court outcomes by location. Cases Dismissed by Reason/Total Cases on Docket Payment Reports, Flagged Vehicles, Trial Requests, Trial Disposition, Unpaid Citations, Summary Report total $ collected from paid citations; separate speed and red light payments. Update monthly for CitiStat. Total value of unpaid citation fines; separate speed and red light. Update monthly for CitiStat. Total and Monthly basis for CitiStat. Total # of paid citations, unpaid (delinquent citations), flagged vehicles, trial requests by location, adjudication outcomes N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run.

DOT

DOT-IT

BRC BRC BRC BRC

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

Violation Date Total Violations Brekford Processing Brekford Accepted Brekford Cancels Client Processing Client Accepted Client Rejected Print Queue Printed 8/1/2013 105 8 37 60 1 36 0 0 36 8/2/2013 86 3 66 17 0 64 2 0 64 8/5/2013 73 4 56 13 1 51 4 11 40 8/6/2013 129 4 56 69 3 40 13 3 37 8/7/2013 103 4 65 34 0 63 2 0 63 8/8/2013 85 4 65 16 0 59 6 0 59 8/9/2013 123 2 99 22 0 91 8 18 73 8/12/2013 89 0 0 89 0 0 0 0 0 8/13/2013 109 7 85 17 0 82 3 4 78 8/14/2013 134 11 98 25 0 95 3 0 95 8/15/2013 110 3 82 25 3 78 1 0 78 8/16/2013 127 9 102 16 2 97 3 0 97 8/19/2013 85 6 67 12 3 58 6 0 58 8/20/2013 111 10 81 20 6 74 1 0 74 8/21/2013 117 6 97 14 1 94 2 94 0 8/22/2013 102 4 60 37 0 39 21 0 39 8/23/2013 108 6 86 16 0 84 2 0 84 8/26/2013 119 8 84 27 4 75 5 0 75 8/27/2013 97 7 73 17 1 71 1 0 71 8/28/2013 82 5 69 8 27 39 3 0 39 8/29/2013 35 1 28 6 28 0 0 0 0 8/30/2013 89 5 64 20 64 0 0 0 0

Totals

2218

117

1520

580

144

1290

86

130

1160

Processing Status August 2013

140 120 100 Client Rejected Axis Title 80 60 40 20 0 8/1/2013 8/2/2013 8/3/2013 8/4/2013 8/5/2013 8/6/2013 8/7/2013 8/8/2013 8/9/2013 8/10/2013 Print Queue Brekford Processing Printed Client Accepted Client Processing Brekford Cancels Brekford Accepted 8/11/2013 Total Violations 8/12/2013 8/13/2013 8/14/2013 8/15/2013 8/16/2013 8/17/2013 8/18/2013 8/19/2013 8/20/2013

8/21/2013

8/22/2013

8/23/2013

8/24/2013

8/25/2013

8/26/2013

8/27/2013

8/28/2013

8/29/2013

8/30/2013

Cancellation Reason Clarity of Tag Dealer Tags Out of State Emergency Response Equipment Malfunction Error Radar Expired Date from MVA Expired Violation Glare of Plate Government Tag Multiple Vehicles No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot Vehicle Mismatch Weather Condition

Date Total 8/1/2013

Date Total 8/2/2013

Date Total 8/5/2013

Date Total 8/6/2013 8/6/2013

5 1

Date Total 8/7/2013

26

Date Total 8/8/2013

Date Total 8/9/2013

Date 4

Total

Date Total 8/13/2013

Date Total 8/14/2013

Total 8 8/15/2013 7

Date Total 8/16/2013

Date Total 8/19/2013 8/19/2013

Date Total 4 8/20/2013 1

Date Total 7 8/21/2013

Date Total 8/22/2013 8/22/2013 8/22/2013 8/22/2013

17 1

Date Total 8/23/2013 8/23/2013

3 1

Date Total 8/26/2013 8/26/2013

11 1

Date Total 8/27/2013

Date Total 8/28/2013

Date 6

Total

Date Total 8/30/2013

8/1/2013 8/1/2013

53 2

1 3 1 1 5 4 2 8/23/2013 8/23/2013 8/23/2013 8/23/2013 8/23/2013 2 1 4 3 1 1 8/26/2013 8/26/2013 3 2 8/27/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 4 1 2 1 1 1 8/27/2013 8/27/2013 8/27/2013 8/27/2013 8/27/2013 1 3 3 1 1 2 17 8/28/2013 1 8/28/2013 1 8/29/2013 8/29/2013 8/29/2013 8/29/2013 3 1 1 1 8/30/2013 8/30/2013 8/30/2013 8/30/2013 8/30/2013 5 2 1 1 1 20 8/27/2013 3 8/30/2013 8/30/2013 1 1

8/2/2013 8/2/2013 8/2/2013 8/2/2013 8/2/2013 8/2/2013

5 3 2 1 1 2

8/5/2013

8/6/2013

5 8/7/2013 8/7/2013 1 1 1 1 2 1 1 34 8/8/2013 8/8/2013 1 1

8/9/2013

5 8/13/2013 1 0 1 6

8/14/2013 8/14/2013 8/14/2013

4 1 1

8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013

1 8/12/2013 89 3 1 3 2 1 2 22

8/13/2013 8/13/2013

8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013

3 1 2 1 3 4 1 2 1 25

8/16/2013 8/16/2013 8/16/2013

4 1 1

8/20/2013 8/20/2013 8/20/2013

4 8/21/2013 1 8/21/2013 1

5 1

8/22/2013 8/22/2013 8/22/2013

8/1/2013 8/1/2013

2 1

8/5/2013 8/5/2013 8/5/2013

1 2 3 2 1 13

8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013

50 2 1 1 2 2 69

8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013

8/8/2013 8/8/2013 8/8/2013 8/8/2013

4 4 2 1 16

8/14/2013 8/14/2013 8/14/2013 8/14/2013

5 4 1 1

8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013

1 1 4 1 1

8/19/2013 8/19/2013 8/19/2013

4 8/20/2013 2 8/20/2013 1 8/20/2013

1 8/21/2013 4 8/21/2013 2 8/21/2013 8/21/2013

2 2 1 2

8/22/2013 8/22/2013 8/22/2013

8/13/2013

8/1/2013 8/1/2013

1 1

8/2/2013 8/2/2013

1 1 17

8/5/2013 8/5/2013

8/22/2013 8/22/2013

1 1 37

8/23/2013

8/13/2013

60

2 17

25

16

12

20

14

16

27

Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Total Sum

121 0 5 53 2 1 0 48 10 12 11 142 55 42 4 32 5 22 8 7 580

Cancellation Reason 8/1/2013 - 8/30/2013


Vehicle Mismatch 1% Temp Tags (Out of State) 1% Test-Shot 4% Rental 6% Weather Condition 1%

8/5/2013 - 8/9/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

39 0 0 0

25% 0% 0% 0%

8/12/2013 - 8/16/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

21 0 0 0

12% 0% 0% 0%

8/19/2013 - 8/23/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Date from MVA Expired Violation

32 0 0 1 0

32% 0% 0% 1% 0%

8/19/2013 - 8/23/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

40 0 0 0

40% 0% 0% 0%

8/26/20138/30/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

28 0 0 0

28% 0% 0% 0%

Other 1%

Emergency Response No Violation Test-Shot


Clarity of Tag 21%

1 50 8

1% 32% 5%

Emergency Response No Violation Test-Shot

0 89 4

0% 52% 2%

Emergency Response No Violation Test-Shot

3 0 4

3% 0% 4%

Emergency Response No Violation Test-Shot

3 0 4

3% 0% 4%

Emergency Response No Violation Test-Shot

1 0 4

1% 0% 4%

Obstructed Vehicle/Plate 7%

Dealer Tags Out of State 0% Emergency Response 1%

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Vehicle Mismatch Weather Condition

0 13 0 2 3 7 9 0 13 2 4 3 154

0% 8% 0% 1% 2% 5% 6% 0% 8% 1% 3% 2% 154

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Vehicle Mismatch Weather Condition

0 11 4 4 2 15 9 0 9 1 1 2 172

0% 6% 2% 2% 1% 9% 5% 0% 5% 1% 1% 1%

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Vehicle Mismatch Weather Condition

0 12 3 3 2 16 15 2 5 0 1 0 99

0% 12% 3% 3% 2% 16% 15% 2% 5% 0% 1% 0%

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Vehicle Mismatch Weather Condition

0 9 1 4 4 16 11 4 4 1 1 2 104

0% 9% 1% 4% 4% 16% 11% 4% 4% 1% 1% 2%

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Vehicle Mismatch Weather Condition

0 7 0 3 2 15 7 2 5 1 1 2 78

0% 7% 0% 3% 2% 15% 7% 2% 5% 1% 1% 2%

Not Found on MVA 9%

Equipment Malfunction 9%

Error Radar 0% Expired Date from MVA 0%

7/29/2013 - 8/2/2013 Clarity of Tag Equipment Malfunction Error Radar Expired Violation

5 149 6 0

2% 65% 3% 0%

Glare of Plate 8%

Expired Violation 0%

Emergency Response No Violation Test-Shot

0 7 10

0% 3% 4%

No Violation 24%

Government Tag 2% Multiple Vehicles 2%

No Rear Plate 2%

Dealer Tags Out of State Glare of Plate Government Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Vehicle Mismatch Weather Condition

0 16 3 5 3 12 7 0 5 1 1 0 230

0% 7% 1% 2% 1% 5% 3% 0% 2% 0% 0% 0% 0

Violation Reason Date Total Equipment Malfunction 8/1/2013 Error Radar 8/1/2013 No Violation 8/1/2013 Not Found on MVA 8/1/2013 Temp Tags (Out of State) 8/1/2013 Test-Shot 8/1/2013

53 2 2 1 1 1 60

Cancellation Reason
60 50 Equipment Malfunction 40 30 20 10 0 41487 Error Radar No Violation Not Found on MVA Temp Tags (Out of State) Test-Shot

Cancellation Reason 8/1/2013


Temp Tags (Out of Not Found on MVA State) No Violation 2% 2% 3% Error Radar 3% Test-Shot 2%

Equipment Malfunction 88%

Violation Reason Date Total Clarity of Tag 8/2/2013 Glare of Plate 8/2/2013 Government Tag 8/2/2013 No Rear Plate 8/2/2013 No Violation 8/2/2013 8/2/2013 Not Found on MVA 8/2/2013 Obstructed Vehicle/Plate Test-Shot 8/2/2013 Vehicle Mismatch 8/2/2013

1 5 3 2 1 1 2 1 1 17

Cancellation Reason
6 5 4 3 2 1 0 41488 Clarity of Tag Glare of Plate Government Tag No Rear Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Test-Shot Vehicle Mismatch

Cancellation Reason 8/2/2013


Vehicle Mismatch 6% Clarity of Tag 6%

Test-Shot 6% Obstructed Vehicle/Plate 12% Not Found on MVA 6% No Violation 6% No Rear Plate 12%

Glare of Plate 29%

Government Tag 17%

Cancellation Reason Clarity of Tag Glare of Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013 8/5/2013

1 3 1 2 3 2 1 13

Cancellation Reason 8/5/2013


Vehicle Clarity of Mismatch Tag 8% 8% Test-Shot 15% Glare of Plate 23%

Cancellation Reason
3.5 3 2.5 2 1.5 1 0.5 0 41491 Clarity of Tag Glare of Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch Rental 23% Not Found on MVA 8% Obstructed Vehicle/Plate 15%

Cancellation Reason Clarity of Tag Emergency Response Glare of Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013 8/6/2013

5 1 5 50 2 1 1 2 2 69

Cancellation Reason
60 Clarity of Tag 50 40 30 20 10 0 41492 Emergency Response Glare of Plate No Violation Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/6/2013


Obstructed Vehicle/Plate 1% Not Found on MVA 3% Vehicle Mismatch Rental Test-Shot 3% 3% 1% Emergency Response 2%

Clarity of Tag 7%

Glare of Plate 7%

No Violation 73%

Cancellation Reason Clarity of Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013 8/7/2013

26 1 1 1 1 2 1 1 34

Cancellation Reason
30 25 20 15 10 5 0 41493 Clarity of Tag Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/7/2013


Test-Shot 3% Obstructed Vehicle/Plate 3% Not Found on MVA 3% No Rear Plate 3% Multiple Vehicles 3% Vehicle Mismatch 3%

Rental 6%

Clarity of Tag 76%

Cancellation Reason Date Total Clarity of Tag 8/8/2013 Multiple Vehicles 8/8/2013 No Rear Plate 8/8/2013 Obstructed Vehicle/Plate 8/8/2013 Rental 8/8/2013 Test-Shot 8/8/2013 Weather Condition 8/8/2013

3 1 1 4 4 2 1 16
4.5

Cancellation Rreason Cancellation Reason 8/8/2013


Weather Condition 6% 4 3.5 3 2.5 2 1.5 Test-Shot 13% Clarity of Tag 19% Multiple Vehicles 6% No Rear Plate 6% Rental 25% Obstructed Vehicle/Plate 25% 1 0.5 0 41494 Clarity of Tag Multiple Vehicles No Rear Plate Obstructed Vehicle/Plate Rental Test-Shot Weather Condition

Cancellation Reason Clarity of Tag Glare of Plate No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Temp Tags (Out of State) Test-Shot Weather Condition

Date Total 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013 8/9/2013

4 5 1 3 1 3 2 1 2 22

Cancellation Reason
6

5 Clarity of Tag 4 Glare of Plate No Rear Plate Not Found on MVA 3 Obstructed Vehicle/Plate Rental 2 Temp Tags (Out of State) Test-Shot 1 Weather Condition

0 8/9/2013

Cancellation Reason 8/9/2013

Weather Condition 9% Test-Shot 5% Clarity of Tag 18%

Temp Tags (Out of State) 9%

Rental 14%

Glare of Plate 23%

Obstructed Vehicle/Plate 4%

Not Found on MVA 14%

No Rear Plate 4%

Cancellation Reason Clarity of Tag Government Tag No Rear Plate Not Found on MVA Rental Weather Condition

Date Total 8/13/2013 8/13/2013 8/13/2013 8/13/2013 8/13/2013 8/13/2013

4 1 1 6 3 2 17

Cancellation Reason
7 6 5 4 Clarity of Tag Government Tag No Rear Plate Not Found on MVA Rental Weather Condition

Cancellation Reason 8/13/2013

3 2 1

Weather Condition 12% Rental 18%

0 Clarity of Tag 23% 8/13/2013

Government Tag 6%

Not Found on MVA 35%

No Rear Plate 6%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicle Obstructed Vehicle/Plate Test-Shot NotFound on MVA Rental

Date Total 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013 8/14/2013

8 4 1 1 4 1 5 1 25

Cancellation Reason
9 8 7 6 5 4 3 2 1 0 8/14/2013 Clarity of Tag Glare of Plate Government Tag Multiple Vehicle Obstructed Vehicle/Plate Test-Shot NotFound on MVA Rental

Cancellation Reason 8/14/2013


Rental 4%

NotFound on MVA 20% Test-Shot 4% Obstructed Vehicle/Plate 16%

Clarity of Tag 32%

Glare of Plate 16%

Multiple Vehicle 4%

Government Tag 4%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicle No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013 8/15/2013

7 3 1 2 1 3 4 1 2 1

Cancellation Reason
8 7 6 5 4 3 Clarity of Tag Glare of Plate Government Tag Multiple Vehicle No Rear Plate Not Found on MVA Obstructed Vehicle/Plate

25

2 1 0 8/15/2013

Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/15/2013


Vehicle Mismatch 4%

Test-Shot 8% Rental 4%

Clarity of Tag 28%

Obstructed Vehicle/Plate 16%

Glare of Plate 12% Not Found on MVA 12%

Multiple Vehicle 8% No Rear Plate 4%

Government Tag 4%

Cancellation Reason Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Temp Tags (Out of State) Test-Shot Not Found on MVA Obstructed Vehicle/Plate Rental

Date Total 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013 8/16/2013

2 4 1 1 1 1 1 1 4 16

Cancellation Reason
5 4 4 3 3 2 2 1 1 0 Clarity of Tag 13% 1/1/1900 Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Temp Tags (Out of State) Test-Shot Not Found on MVA Obstructed Vehicle/Plate Rental

Cancellation Reason 8/16/2013

Rental 25%

Obstructed Vehicle/Plate 6%

Glare of Plate 25%

Not Found on MVA 6% Test-Shot 6% Multiple Vehicles 6%

Government Tag 7%

Temp Tags (Out of State) 6%

Violation Reason Clarity of Tag Emergency Response Not Found on MVA Obstructed Vehicle/Plate Rental

Date Total 8/19/2013 8/19/2013 8/19/2013 8/19/2013 8/19/2013

4 1 4 2 1 12

Cancellation Reason
4.5 4 3.5 3 2.5 2 1.5 1 0.5 Rental 8% 0 8/19/2013 Clarity of Tag Emergency Response Not Found on MVA Obstructed Vehicle/Plate Rental

Cancellation Reason 8/19/2013

Obstructed Vehicle/Plate 17%

Clarity of Tag 34%

Not Found on MVA 33%

Emergency Response 8%

Violation Reason Date Total Clarity of Tag 8/20/2013 Glare of Plate 8/20/2013 Government Tag 8/20/2013 Multiple Vehicles 8/20/2013 Not Found on MVA 8/20/2013 Obstructed Vehicle/P 8/20/2013 Rental 8/20/2013

7 4 1 1 1 4 2 20

Cancellation Reason
8 7 6 5 4 3 2 1 Rental 10% 0 8/20/2013 Clarity of Tag Glare of Plate Government Tag Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Rental

Cancellation Reason 8/20/2013

Obstructed Vehicle/Plate 20%

Clarity of Tag 35%

Not Found on MVA 5% Multiple Vehicles 5% Government Tag 5% Glare of Plate 20%

Violation Reason Clarity of Tag Glare of Plate Government Tag Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Date Total 8/21/2013 8/21/2013 8/21/2013 8/21/2013 8/21/2013 8/21/2013 8/21/2013

1 5 1 2 2 1 2 14

Cancellation Reason
6 5 4 Clarity of Tag Glare of Plate Government Tag 3 2 Clarity of Tag 7% 1 0 8/21/2013 Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Cancellation Reason 8/21/2013

Test-Shot 14% Rental 7%

Obstructed Vehicle/Plate 14%

Glare of Plate 36%

Not Found on MVA 15%

Government Tag 7%

Violation Reason Date Total Clarity of Tag 8/22/2013 Emergency Response 8/22/2013 Expired Date from MVA 8/22/2013 Glare of Plate 8/22/2013 Government Tag 8/22/2013 No Rear Plate 8/22/2013 Not Found on MVA 8/22/2013 Obstructed Vehicle/Plate 8/22/2013 Other 8/22/2013 Test-Shot 8/22/2013 Vehicle Mismatch 8/22/2013

17 1 1 3 1 1 5 4 2 1 1 36

Cancellation Reason
18 Clarity of Tag 16 14 12 10 8 6 4 2 Emergency Response Expired Date from MVA Glare of Plate Government Tag No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Other Test-Shot 41508 Vehicle Mismatch

Cancellation Reason 8/22/2013


Test-Shot Vehicle Mismatch 3% 3%

Other 5%

Obstructed Vehicle/Plate 11% Clarity of Tag 46% Not Found on MVA 13%

No Rear Plate 3% Government Tag 3%

Glare of Plate 8% Emergency Expired Date from MVA Response 3% 2%

Violation Reason Date Total Clarity of Tag 8/23/2013 Emergency Response 8/23/2013 Multiple Vehicles 8/23/2013 No Rear Plate 8/23/2013 Not Found on MVA 8/23/2013 Obstructed Vehicle/Plate8/23/2013 Rental 8/23/2013 Test-Shot 8/23/2013

3 1 2 1 4 3 1 1 16

Cancellation Reason
4.5 4 3.5 3 2.5 2 Clarity of Tag Emergency Response Multiple Vehicles No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot 8/23/2013 Clarity of Tag 19% Emergency Response 6% Multiple Vehicles 13%

Cancellation Reason 8/23/2013


Test-Shot 6%

1.5 1 0.5 0

Rental 6%

Obstructed Vehicle/Plate 19%

Not Found on MVA 25% No Rear Plate 6%

Violation Reason Clarity of Tag Emergency Response Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State) Test-Shot

Date Total 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013 8/26/2013

11 1 3 2 4 1 2 1 1 1 27

Cancellation Reason
12 10 8 6 4 2 0 41512 Clarity of Tag Emergency Response Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Other Rental Temp Tags (Out of State)

Cancellation Reason 8/26/2013


Temp Tags (Out of State) 4% Rental 4% Test-Shot 4%

Obstructed Vehicle/Plate 4%

Other 7% Clarity of Tag 41% Not Found on MVA 15%

Multiple Vehicles 7% Glare of Plate 11%

Emergency Response 3%

Violation Reason Date Total Clarity of Tag 8/27/2013 Glare of Plate 8/27/2013 No Rear Plate 8/27/2013 Not Found on MVA 8/27/2013 Obstructed Vehicle/Plate 8/27/2013 Test-Shot 8/27/2013 Weather Condition 8/27/2013

3 3 1 3 3 1 2 16

Cancellation Reason
3.5 3 2.5 2 1.5 1 0.5 0 8/27/2013 Clarity of Tag Glare of Plate No Rear Plate Not Found on MVA Obstructed Vehicle/Plate Test-Shot Weather Condition

Cancellation Reason 8/27/2013

Test-Shot 6%

Weather Condition 12%

Clarity of Tag 19%

Obstructed Vehicle/Plate 19%

Glare of Plate 19%

Not Found on MVA 19%

No Rear Plate 6%

Violation Reason Clarity of Tag No Rear Plate Rental

Date Total 8/28/2013 8/28/2013 8/28/2013

6 1 1 8

Cancellation Reason
7 6 5

Cancellation Reason 8/28/2013


Rental 13%

4 3 2 1 0 41514

Clarity of Tag No Rear Plate Rental

No Rear Plate 12%

Clarity of Tag 75%

Violation Reason Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Date Total 8/29/2013 8/29/2013 8/29/2013 8/29/2013

3 1 1 1

Cancellation Reason Cancellation Reason 8/29/2013


3.5 3 2.5 2 Test-Shot 17% 1.5 1 0.5 Rental 17% Not Found on MVA 50% 0 8/29/2013 Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot

Obstructed Vehicle/Plate 16%

Violation Reason Clarity of Tag Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Date Total 8/30/2013 8/30/2013 8/30/2013 8/30/2013 8/30/2013 8/300/2013 8/30/2013 8/30/2013

8 1 1 5 2 1 1 1 20

Cancellation Reason
9 8 7 6 5 4 3 2 1 0 8/30/2013 Clarity of Tag Glare of Plate Multiple Vehicles Not Found on MVA Obstructed Vehicle/Plate Rental Test-Shot Vehicle Mismatch

Cancellation Reason 8/30/2013


Test-Shot Vehicle Mismatch 5% 5%

Rental 5% Obstructed Vehicle/Plate 10%

Clarity of Tag 40%

Not Found on MVA 25%

Multiple Vehicles 5%

Glare of Plate 5%

Performance Metrics During Test Run


Metric Data Components (Description); Comments

Controllable Cancellations by Vendor by Reason and Location

Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc. LC 2054 only. Controllable Errors should be less than 5%.

7/15 -7/26/2013 Comments Total Events - 1676 Clarity of Plate - 9% (51) (of all cancellations) Equipment Malfunction - 50% (291) Error Radar - 0% (1) Expired Violation - 1% (4) Controllable Errors: 21%

7/29-8/2/2013 Comments Total Events- 532 Clarity of Plate - 3% (5) (of all cancellations) Equipment Malfunction - 71% (149) Error Radar - 4% (6) Controllable Errors: 30% Glare on Plate - 7% (16) Government Tag - 1% (3) Multiple Vehicles - 2% (5) No Rear Plate - 1% (3) Not Found on MVA - 5% (12) Obstructed Vehicle/Plate - 3% (7) Rental - 2% (5) Temp Tags (Out of State) - 0% (1) Vehicle Mismatch - 0% (1) Uncontrollable Errors: 8%

8/5-8/9/2013 Comments Total Events - 513 Clarity of Plate - 25% (39) (of all cancellations) Controllable Errors: 8%

8/12-8/16/2013 Comments Total Events - 569 Clarity of Plate - 12% (21) (of all cancellations) Controllable Errors: 4%

8/19-8/23/2013 Comments Total Events - 523 Clarity of Plate - 32% (32) (of all cancellations) Expired Date from MVA - 1% (1) Controllable Errors: 6%

8/26-8/30/2013 Comments Total Events - 428 Clarity of Plate - 41% (34) (of all cancellations) Controllable Errors: 8%

Vendor Uncontrollable Cancellations by Vendor by Reason and Location

Dealer Tags Out of State - 1% (3) Glare on Plate - 2% (9) Government Tag - 1% (4) Multiple Vehicles - 3% (19) No Rear Plate - 2% (13) Citation should have been issued but wasnt, not due to vendor. Not Found on MVA - 7% (39) Multiple vehicles in image, info not found at MVA, etc. LC 2054 Obstructed Vehicle/Plate - 8% (46) Other - 1% (3) only. Rental - 4% (26) Temp Tags (Out of State) - 1% (5) Vehicle Mismatch - 1% (4) Weather Condition - 1% (3) Uncontrollable Errors: 10 % Emergency Response - 0% (1) No Violation - 7% (38) Test-Shot - 4% (21) Total Events: 1676 Vendor Accepted: 1012 Percent Accepted: 60% Vendor Cancellation: 582 Percent Canceled: 35% Still Processing: 82 Percent Still Processing: 5%

Glare on Plate - 10% (13) Multiple Vehicles - 1% (2) No Rear Plate - 2% (3) Not Found on MVA - 5% (7) Obstructed Vehicle/Plate - 6% (9) Rental - 18% (13) Temp Tags(Out of State) - 1% (2) Vehicle Mismatch - 3% (4) Weather Condition - 2% (3) Uncontrollable Errors: 10%

Glare on Plate - 6% (11) Government Tags - 2% (4) Multiple Vehicles - 2% (4) No Rear Plate - 1% (2) Not Found on MVA - 9% (15) Obstructed Vehicle/Plate - 5% (9) Rental - 4% (9) Temp Tags(Out of State) - 1% (1) Vehicle Mismatch - 1% (1) Weather Condition - 1% (2) Uncontrollable Errors: 8%

Glare of Plate - 12% (12) Government Tags - 3% (3) Multiple Vehicles - 3% (3) No Rear Plate - 2% (2) Not Found on MVA - 16% (16) Obstructed Vehicle/Plate - 15% (15) Other - 2% (2) Rental - 5% (5) Vehicle Mismatch - 1% (1) Uncontrollable Errors: 11%

Glare of Plate - 8% (7) Multiple Vehicles - 4% (3) No Rear Plate - 2% (2) Not Found on MVA - 18% (15) Obstructed Vehicle/Plate - 8% (7) Other - 2% (2) Rental - 6% (5) Temp Tags (Out of State) - 1% (1) Vehicle Mismatch - 1% (1) Weather Condition - 3% (2) Uncontrollable Errors: 11%

Non-Violations Canceled by Vendor by No violation occurred so canceled. Funeral procession, second Reason and Location speed below threshold, etc. Only LC 2054 only.

No Violation - 3% (7) Test-Shot - 4% (10)

Emergency Response - 1% (1) No Violation - 32% (50) Test-Shot - 5% (8) Total Events: 513 Vendor Accepted: 341 Percent Accepted: 66% Vendor Cancellation: 154 Percent Canceled: 30% Still Processing: 18 Percent Still Processing: 4%

No Violation - 52% (89) Test-Shot - 6% (4)

Emergency Response - 3% (3) Test-Shot - 4% (4)

Emergency Response - 1% (1) Test-Shot - 5% (4)

Vendor Cancellation Rate

Violations Canceled by Vendor/Total Violations captured should be 20% - 40%. Initial Analyst or 2nd Analyst cancels.

Total Events: 532 Vendor Accepted: 280 Percent Accepted: 53% Vendor Cancellation: 230 Percent Canceled: 43% Still Processing: 22 Percent Still Processing: 4%

Total Events: 569 Vendor Accepted: 367 Percent Accepted: 64% Vendor Cancellation: 172 Percent Canceled: 30% Still Processing: 30 Percent Still Processing: 6%

Total Events: 523 Vendor Accepted: 391 Percent Accepted: 75% Vendor Cancellation: 99 Percent Canceled: 19% Still Processing: 32 Percent Still Processing: 6% Discarded: 1 Percent Discarded: 0.1% BPD Start Up Log Error: 0

Total Events: 428 Vendor Accepted: 319 Percent Accepted: 75% Vendor Cancellation: 84 Percent Canceled: 20% Still Processing: 25 Percent Still Processing: 6%

# of times PCU was unable to setup properly

BPD not able to log into camera, can't take test shot, or verify equipment is working properly. Brekford usually gets them working by the afternoon on same day.

BPD Start Up Log Error: 3

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

# of times PCU was unable to close out Camera shuts down prematurely during the day, can't take test properly shot, etc. All events get discarded on a per camera per day basis. BPD Rejection Rate

BPD Close Out Log Error: 5

BPD Close Out Log Error: 1

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

Vendor Accepts: 1012 Violations Rejected by BPD/Total Violations Accepted by Vendor; BPD Rejects: 48 should be under 10% Percent Reject: 5% Clarity of Plate: 25 Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc. LC 2054 only.

Vendor Accepts: 280 BPD Rejects: 4 Percent Rejected: 1% Clarity of Plate: 2 Dark Environment: 2

Vendor Accepts: 341 BPD Rejects: 33 Percent Rejected: 10% Clarity of Plate: 20

Vendor Accepts: 367 BPD Rejects: 10 Percent Rejected: 3% Clarity of Plate: 5

Vendor Accepts: 391 BPD Rejects: 32 Percent Rejected: 8% Clarity of Plate: 24 Dark Environment: 4 Site Error: 1

Vendor Accepts: 319 BPD Rejects: 13 Percent Rejected: 3% Clarity of Plate: 7

Controllable Violations Rejected by BPD by Reason and Location

Glare of Plate: 5 Citation should have been issued but wasnt, not due to vendor. Multiple Vehicles: 11 Uncontrollable Violations Rejected by Multiple vehicles in image, info not found at MVA, etc. LC 2054 Obstructed Vehicle/Plate: 5 BPD by Reason and Location Stolen Plate: 1 only. Non-Violations Rejected by BPD by Reason and Location DOT No violation occurred so canceled. Funeral procession, second speed below threshold, etc. LC 2054 only. No Violations: 1 Issues were noted with loca on of reference lines moving. Also, some vehicles appearing to be out of position (early triggers). Brekford re-reviewed and did cancellations after URS brought these issues to their attention. URS noted the following issues from a review of printed citations: 19700681 - Back-Side of citation is missing 19999184 - Clarity of Plate Issue 19999887 - Clarity of Plate Issue 19999895 - Clarity of Plate Issue 19999382 - Unable to Identify Make of Vehicle 19702489 - Unable to Identify Make of Vehicle DOT Voids - Total Total citations voided or recommended for voiding by DOT/URS. None. A few violations appeared to have early triggers - sent back to Brekford to re-review. URS noted the following issues from a review of printed citations: 19998731 - Digital Line is not Aligned Properly 19999432 - Unable to Identify Make of Vehicle 19703735 - Clarity of Plate Issue and Unable to Identify Make of Vehicle 19703727 - Clarity of Plate Issue and Unable to Identify Make of Vehicle 19703461 - Unable to Identify Make of Vehicle 19703669 - Unable to Identify Make of Vehicle 19705235 - Another Vehicle Entered Radar Zone. 19705383 - Unable to Identify Make of Vehicle 19704840 - Clarity of Plate Issue 19705532 - Clarity of Plate Issue 19705367 - Clarity of Plate Issue

Glare of Plate: 3 Multiple Vehicles: 10

Glare of Plate: 1 Multiple Vehicles: 4

Glare of Plate: 2 Multiple Vehicles: 1

Glare of Plate: 4 Multiple Vehicles: 1 Obstructed Vehicle/Plate: 1

None. A few images appear to be dark and/or clarity of plate a concern - Brekford to reassess. URS noted the following issues from a review of printed citations: 19705953 - Clarity of Plate Issue 19706183 - Clarity of Plate Issue

None.

None.

None. Clarity of Plate issues remain a concern. 4 voided cita ons by DOT (19700681, 19998731, 19998624, 19999242) should not have been issued.

URS noted that there were a few concerns with URS noted issues with clarity of plate still remain. clarity of plate. Brekford said they would re-review. One Citation was discared for being "out of date". Quantity of citations in queue remains inconsistent only provided 46 on 8/14, no others provided.

Voids by Reason

Total Voided Citations by Reason; Under Investigation (UI) codes: Stolen Vehicle (SV), Stolen Tags (ST), Owner Death (OD), Funeral Procession (FP), Bankruptcy (BR), Official Police Business (PD), Rental/Lease Exemptions (RE), Voided by DOT (VD)

Not testing UI codes until September per DOT-IT.

Not testing UI codes until September per DOT-IT.

Not testing UI codes until September per DOT-IT.

Not testing UI codes until September per DOT-IT.

Not testing UI codes until September per DOT-IT.

Not testing UI codes until September per DOT-IT.

MOIT/ DOT-IT

# of errors in daily data uploads from Vendor.

# of citations that failed to upload to MOITs mainframe per day (bounced out). Vendor needs to resubmit those within 1 day.

No files transferred in the 1st week. 2nd week data showed some errors in content and format.

343 citations had to be discarded in the test run because the batch of citation #s was incorrect. That problem has been corrected.

All 116 citations rejected on 08/09/13. Unable to get updates for the rest of the week due to IT issues. No other data transfers, possibly due to DOT-IT not downloading citation data from ftp site.

Unable to get updates all week due to IT issues. No 08/21 Error Report (PF 690), no errors but only 10 No data transfers possibly due to DOT-IT Chief data transfers, possibly due to DOT-IT not leaving City. citations. downloading citation data from ftp site. 08/22 Error report (PF 690) by MOIT not complete (just a summary) but no errors, but only 39 citations.

# of discrepancies in data sets between MOIT and iP360.

Dummy files during Test Run. Check every week. Problem in the Not checked by DOT-IT. past with openbaltimore data.

Not checked by DOT-IT.

Not checked by DOT-IT.

Not checked by DOT-IT.

Not checked by DOT-IT.

Not checked by DOT-IT.

Issues Monitored During Test Run


Metric Description; Comments Rejection Codes in iP360 match the DOT verifies. ones in the latest Business Rules. PDF conversion of citations in iP360 is Citations are cast in stone; same in iP360 as print out. DOT working properly verifies. Latest Business Rules not yet finalized. URS using version provided 4/12/13. PDFs are not being modified. Latest Business Rules not yet finalized. URS using version provided 4/12/13. PDFs are not being modified. Latest Business Rules not yet finalized. URS using version provided 4/12/13. PDFs are not being modified. Latest Business Rules not yet finalized. URS using version provided 4/12/13. PDFs are not being modified. Business Rules Provided - Rejection Codes appear to URS noted no issues with Rejection Codes match PDFs are not being modified. PDFs are not being modified.

iP360 is working properly

Vendor is working with BPD to address Closeout Log Issues. URS also experienced some issues with accessing iP360 and quantity of citations provided for review Data is complete and accurate; new version (3.0) is working was inconsistent. properly; able to handle test run; rolling right data is separated URS does not have access to violations cancelled by from straight through; separate test run data from real data. Brekford. Vendor isn't making any changes to the data or purging any data. Problems with BPD Supervisor Queue to view rejected violations - shows zero in queue.

Vendor is working with BPD to address Closeout Log Issues. There were issues identified with Brekford providing adequate access to URS for timely QC checks before BPD review. URS does not have access to violations canceled by Brekford. S ll problems with BPD supervisor queue.

Issue of 1 voided citation that was found missing in ip360 came up. Vendor will investigate how many vendor voids are missing from ip360. Vendor will also look into capturing voids on ip360. URS does not have access to violations canceled by Brekford. S ll problems with BPD supervisor queue.

Brekford said data will not be purged anymore from iP360. No violations to review in iP360 for 2 days this week due to iP360 program issues (resolved by Brekford on 08/14/13). URS does not have access to violations canceled by Brekford. Still problems with BPD supervisor queue.

URS does not have access to the canceled violations. Problems with BPD Supervisor Queue to view rejected violations.

URS nally got access to the canceled viola ons. Problems with BPD Supervisor Queue to view rejected violations. Brekford updated iP360 again on 08/23/13 (see release notes). BPD noted a glitch in iP360 w/ RL cita ons repeating (fixed by Brekford on 09/10/13).

Queues in iP360 are properly filled Reports are generated accurately Updated citation template is being used. Vendor

Queues listed in Business Rules. BPD verifies.

Queues are being filled up.

Queues are filled up inconsistently. No report submitted by Brekford. Not approved yet. Using previous template.

Queues are filled up inconsistently. No report submitted by Brekford. Not approved yet. Using previous template. No issues reported

Queues are filled up inconsistently. No report submitted by Brekford. Not approved yet. Using previous template. No issues reported

Queues are filled up inconsistently. No report submitted by Brekford. Not approved yet. Using previous template.

Queues are filled up inconsistently. No report submitted by Brekford. Not approved yet. Using previous template.

All reports are done properly and on time including the monthly N/A report in SHAs format. DOT verifies. Not approved yet. Using previous template.

All vendors SOPs are being properly followed.

Consultant on site to oversee vendors operations.

No issues reported Vendor changed camera alignment during maintenance work. This caused misalignment in the report lines and camera shut-down on 7/25/13 afternoon. DOT has informed vendor to re-verify all camera settings after all maintenance activities on the camera in accordance to the established SOP.

URS not yet provided with Monthly QA Report. URS URS has not reviewed Monthly QA Report or TPA logs. also has not seen Transaction Processing Agent (TPA) logs.

Processing rate is uniform. iCourt has documents as 1 PDF per case

No lopsided huge mass processing in one day. DOT verifies. DOT verifies.

No issues reported. N/A yet. Brekford has been communicating better with DOT.

No issues reported. N/A yet. Brekford has been communicating better with DOT.

No issues reported. N/A yet. DOT found 1 (real) citation (TR) that was missing in ip360. Vendor will investigate how many vendor voids are missing from ip360.

Quantity of violations in queues are inconsistent. N/A yet. No issues reported.

No issues reported. N/A yet. No issues reported.

No issues reported. N/A yet. No issues reported.

No changes are made without DOT approval.

Maintain proper communication with the client.

All citations are mailed to DOT before Deliver to DOT by 13th day from violation date for in state, 29th the mail dates. iP360 to reflect data by day for out of state. DOT verifies. the next morning. All City's SOPs are being properly followed.

Complied.

Delay due to invoice. Delivered to DOT on 08/22/13.

Delay due to invoice. Delivered to DOT on 08/22/13.

Delay due to invoice. Delivered to DOT on 08/22/13.

DOT received a box of citations on 08/22/13 for citations up to 08/18/13. Delay was due to invoice approval.

No citations delivered to DOT this week.

Yes. Need to update the Business Rules. Problems with closing down cameras several mes (violations discarded those days); Problem se ng up one camera on 3 dierent days (Brekford setup in afternoon); Access problems in iP360; URS no ced reference lines moving and some early triggers; URS does not have access to the canceled viola ons in iP360; Other data transfer issues were reported by IT; BPD Supervisor queue not working in iP360; High controllable error rate.

Yes. Need to update the Business Rules. Problem with closing down camera one day violations discarded; 343 citations (4 days worth) had to be discarded since they failed to transfer to City's mainframe due to citation #'s being incorrect; There were some more violations with early triggers; Reference lines still not fixed; URS does not have access to the canceled viola ons in iP360; BPD Supervisor queue not working in iP360; High controllable error rate.

Yes. Need to update the Business Rules. Some issues with clarity of images; Data transfer issues were reported by IT; BPD supervisor queue not working in iP360; DOT found out that Brekford had deleted cita ons in iP360 that were issued when we were live. Brekford never informed DOT how many; URS does not have access to the canceled viola ons in iP360.

Yes. Need to update the Business Rules. iP360 not working properly for 2 days this week due to glitch in program; Quantity of citations in queue is inconsistent; BPD supervisor queue in iP360 not working; URS does not have access to the canceled violations in iP360; Some #'s appear to be changing in iP360 such as BPD rejections.

Yes. Need to update the Business Rules. BPD supervisor queue in iP360 not working; Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs; URS does not have access to the canceled violations in iP360; Clarity of plate issues s ll remain; Some BPD rejects appear to be valid.

Yes. Need to update the Business Rules. BPD supervisor queue in iP360 not working; BPD noted a glitch in iP360 w/ RL cita ons repeating (Bkfd fixed on 09/10/13); Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs; Clarity of some images remain a concern and URS noted consistent image quality problems during the dusk and dawn hours - Brekford working on a filter; Brekford updated iP360 (again) on 08/23; DOT no ced that BPD had rejected some valid citations during the Test Run - retraining needed. DOT cita on review - detatch lines misaligned, citation 19700681 has blank back side, 3 questionable citations should not have been issued (19998731, 19998624, 19999242).

Is ATVES Program running error free? Note any significant issues.

DOT

N/A, beginning of Test Run.

URS queue fixed.

Issues resolved

Reference lines have been xed - Brekford is welding iP360 glitch was resolved on 08/14/13. brackets to the trays (in all PCUs) to stabilize the trays. No startup or close out problems with PCU this Access problems in iP360 appear to have been xed. week. No starteup or close out problems with PCU this week. Controllable Error Rate much be er.

No startup or close out problems with PCU this week.

URS nally got access to the canceled viola ons in iP360. No startup or close out problems with PCU this week. Good controllable error rate 4 weeks in a row.

There are no erroneous citations.

No erroneous citations out of the 53 reviewed except No printed citations to review this week from Brekford. No printed citations to review this week from Brekford. No printed citations to review this week from Brekford. A % of violations will be reviewed by URS in iP360 before they go as noted for citation 19997493, speed reading looks to BPD. All printed citations will be reviewed by DOT during Test questionable. Run.

Received printed citations on 08/22/13 for citations 3 questionable citations found that should not have been issued. up to 08/18/13. DOT gave comments the next week.

Phony Trial Requests BRC Phony payment, trial and flagging

Total # of phony trial requests created same as total # trial requests received by DOT and vendor. Dummy files. BRC will determine which citations to make trial requests for. Total # of phony payment, trial and flagging created is same as total # of trial, payment, and flagging data received by DOT and vendor. Dummy files. BRC will make up data to test data transfers. DOT-IT will upload data from vendor to OnBase daily. DOT verifies. Automated daily data transfer is occurring between Brekford, MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT Automated daily data transfer is occurring between MOIT and DOT-IT

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

DOT Traffic can retrieve data in OnBase Payment, trial and flagging data is uploaded into iP360 daily Reports and data accessible in csv format Monthly report sent to DOT to check invoices, accessible on Mainframe also. Cases Dismissed Rate Overall and by Location Cases Upheld Rate Overall and by Location Cases Dismissed Rate Overall and by Reason Monthly Reports Generated from Data in System Total $ Collected from Paid Citations Total # of Delinquent Citations Total Trial Requests by Location Monitor citation status

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

MOIT/ DOT-IT

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Other Performance Metrics When We Go Live


Cases Dismissed by Location/Total Cases on Docket by Location Cases Upheld by Location/Total Cases on Docket by Location; gauge court outcomes by location. Cases Dismissed by Reason/Total Cases on Docket Payment Reports, Flagged Vehicles, Trial Requests, Trial Disposition, Unpaid Citations, Summary Report N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run.

DOT

DOT-IT

BRC BRC BRC BRC

total $ collected from paid citations; separate speed and red light N/A for Test Run. payments. Update monthly for CitiStat. Total value of unpaid citation fines; separate speed and red light. N/A for Test Run. Update monthly for CitiStat. Total and Monthly basis for CitiStat. N/A for Test Run. N/A for Test Run. Total # of paid citations, unpaid (delinquent citations), flagged vehicles, trial requests by location, adjudication outcomes

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

Performance Metrics During Test Run


Metric Data Components (Description); Comments

7/15 -7/26/2013 Comments Total Events - 1676 Clarity of Plate - 9% (51) (of all cancellations) Equipment Malfunction - 50% (291) Error Radar - 0% (1) Expired Violation - 1% (4) Controllable Errors: 21%

7/29-8/2/2013 Comments Total Events- 532 Clarity of Plate - 3% (5) (of all cancellations) Equipment Malfunction - 71% (149) Error Radar - 4% (6) Controllable Errors: 30%

8/5-8/9/2013 Comments Total Events - 513 Clarity of Plate - 25% (39) (of all cancellations) Controllable Errors: 8%

8/12-8/16/2013 Comments Total Events - 569 Clarity of Plate - 12% (21) (of all cancellations) Controllable Errors: 4%

8/19-8/23/2013 Comments Total Events - 523 Clarity of Plate - 32% (32) (of all cancellations) Expired Date from MVA - 1% (1) Controllable Errors: 6%

8/26-8/30/2013 Comments Total Events - 428 Clarity of Plate - 41% (34) (of all cancellations) Controllable Errors: 8%

9/2-9/6/2013 Comments Total Violations - 342 Clarity of Plate - 12% (18) (of all cancellations) Equipment Malfunction - 57% (86) Controllable Errors: 30%

9/9-9/13/2013 Comments Total Violations - 473 Clarity of Plate 40% (45) (of all cancellations) Controllable Errors: 10%

9/16-9/20/2013 Comments Total Violations - 602 Clarity of Plate 38% (66) (of all cancellations) Controllable Errors: 11%

9/23-9/27/2013 Comments Total Violations - 151 Clarity of Plate 21% (14) (of all cancellations) Dark Environment - (multiple) Controllable Errors: 10%

9/30-10/4/2013 Comments Total RLC Violations: Clarity of Plate - 4% (56) (of all violations) Cropped Vehicle - 2% (28) Dark Environment 0.6% (9) Duplicate Vehicle - 4% (54) Equipment Malfunction - 1% (17) Expired Violation 0.1% (2) Missing Image 0.7% (11) Controllable Errors: 10% (177) Total PCU Violations 3217 Clarity of Plate 15% (148) (of all cancellations) Dark Environment 0.1% (1) Cropped Vehicle - 2% (20) Out of Position - 13% (131) Controllable Errors: 9%

10/7-10/11/2013 Comments Total RLC Violations 2609 Clarity of Plate - 4% (45) (of all cancellations) Cropped Vehicle 2% (30) Dark Environment - 2% (25) Duplicate Violation - 4% (49) Equipment Malfunction 1% (17) Expired Date from MVA 0.1% (1) Officer Present - 1% (13) Controllable Errors: 14% (180) Total PCU Violations 2999 Clarity of Plate 12% (102) (of all cancellations) Cropped Vehicle - 1% (6) Dark Environment 2% (16) Equipment Malfunction - 0.2% (2) Out of Position - 22% (185) Controllable Errors: 37% RLC Violations: Funeral Procession 0.4% (5) Glare of Plate 0.2% (3) No Rear Plate - 2% (22) Not Found on MVA - 4% (47) Obstructed Vehicle/Plate - 5% (61) Other - 1% (19) Plate Damage 0.1% (1) Rental - 4% (53) Temp Tags (Out of State) 0.6% (7) Vehicle Mismatch 0.8% (10) Weather Condition 0.6% (8) Uncontrollable Errors: 19% (236) PCU Violations: Glare of Plate 0.2% (2) Multiple Vehicles - 8% (64) No Rear Plate - 2% (19) Not Found on MVA 13% (111) Obstructed Vehicle/Plate - 8% (68) Other - 1% (12) Rental - 6% (52) Temp Tags (Out of State) - 0.1% (1) Vehicle Mismatch - 2% (15) Weather Condition - 3% (26) Uncontrollable Errors: 43%

10/14-10/18/2013 Comments Total RLC Violations 2852 Clarity of Plate 2% (49) (of all cancellations) Cropped Vehicle - 1% (28) Dark Environment 0.4% (11) Equipment Malfunction - 1% (37) Controllable Errors: 4% (125) Total PCU Violations 5534 Clarity of Plate 4% (52) (of all cancellations) Cropped Vehicle - 2% (29) Dark Environment 1% (12) Duplicate Violation - 5% (67) Equipment Malfunction - 3% (38) Controllable Errors: 15% Total RLC Violations 2977 Clarity of Plate 2% (28) (of all cancellations) Cropped Vehicle - 1% (12) Dark Environment 0.3% (5) Duplicate Violation - 4% (64) Equipment Malfunction - 5% (72) Missing Image - 0.2% (3) Controllable Errors: 13% Total PCU Violations 5099 Clarity of Plate 6% (61) (of all cancellations) Cropped Vehicle - 0.7% (7) Dark Environment 2% (20) Equipment Malfunction - 11% (107 ) Controllable Errors: 20%

10/21-10/25/2013 Comments

Controllable Cancellations by Vendor by Reason and Location

Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc. LC 2054 only speed camera until 10/01. Controllable Errors should be less than 5%.

Vendor

Uncontrollable Cancellations by Vendor by Reason and Location

Citation should have been issued but wasnt, not due to vendor. Multiple vehicles in image, info not found at MVA, etc. LC 2054 only speed camera until 10/01.

Dealer Tags Out of State - 1% (3) Glare on Plate - 2% (9) Government Tag - 1% (4) Multiple Vehicles - 3% (19) No Rear Plate - 2% (13) Not Found on MVA - 7% (39) Obstructed Vehicle/Plate - 8% (46) Other - 1% (3) Rental - 4% (26) Temp Tags (Out of State) - 1% (5) Vehicle Mismatch - 1% (4) Weather Condition - 1% (3) Uncontrollable Errors: 10%

Glare on Plate - 7% (16) Government Tag - 1% (3) Multiple Vehicles - 2% (5) No Rear Plate - 1% (3) Not Found on MVA - 5% (12) Obstructed Vehicle/Plate - 3% (7) Rental - 2% (5) Temp Tags (Out of State) - 0% (1) Vehicle Mismatch - 0% (1) Uncontrollable Errors: 8%

Glare on Plate - 10% (13) Multiple Vehicles - 1% (2) No Rear Plate - 2% (3) Not Found on MVA - 5% (7) Obstructed Vehicle/Plate - 6% (9) Rental - 18% (13) Temp Tags(Out of State) - 1% (2) Vehicle Mismatch - 3% (4) Weather Condition - 2% (3) Uncontrollable Errors: 10%

Glare on Plate - 6% (11) Government Tags - 2% (4) Multiple Vehicles - 2% (4) No Rear Plate - 1% (2) Not Found on MVA - 9% (15) Obstructed Vehicle/Plate - 5% (9) Rental - 4% (9) Temp Tags(Out of State) - 1% (1) Vehicle Mismatch - 1% (1) Weather Condition - 1% (2) Uncontrollable Errors: 8%

Glare of Plate - 12% (12) Government Tags - 3% (3) Multiple Vehicles - 3% (3) No Rear Plate - 2% (2) Not Found on MVA - 16% (16) Obstructed Vehicle/Plate - 15% (15) Other - 2% (2) Rental - 5% (5) Vehicle Mismatch - 1% (1) Uncontrollable Errors: 11%

Glare of Plate - 8% (7) Multiple Vehicles - 4% (3) No Rear Plate - 2% (2) Not Found on MVA - 18% (15) Obstructed Vehicle/Plate - 8% (7) Other - 2% (2) Rental - 6% (5) Temp Tags (Out of State) - 1% (1) Vehicle Mismatch - 1% (1) Weather Condition - 3% (2) Uncontrollable Errors: 11%

Glare of Plate - 11% (16) Multiple Vehicles - 3% (4) No Rear Plate - 3% (4) Not Found on MVA - 7% (10) Obstructed Vehicle/Plate - 2% (3) Rental - 4% (6) Vehicle Mismatch - 1% (1) Uncontrollable Errors: 13%

Glare of Plate 13% (14) Multiple Vehicles 5% (6) No Rear Plate 1% (1) Not Found on MVA 18% (20) Obstructed Vehicle/Plate - 5% (5) Plate Damage 1% (1) Rental 4% (4) Vehicle Mismatch 2% (2) Uncontrollable Errors: 11%

Glare of Plate 15% (27) Multiple Vehicles 6% (10) No Rear Plate 2% (3) Not Found on MVA 14% (25) Obstructed Vehicle/Plate - 9% (16) Rental 6% (11) Temp Tags (Out of State) - 1% (2) Uncontrollable Errors: 16%

Glare of Plate 28% (19) Not Found on MVA 7% (5) Obstructed Vehicle/Plate - 6% (4) Uncontrollable Errors: 19%

RLC Violations: Funeral Procession - 1% (21) Glare of Plate 0.8% (12) Government Tag 0.1% (1) Multiple Vehicles 0.1% (1) No Rear Plate 0.6% (10) Not Found on MVA - 4% (59) Obstructed Vehicle/Plate - 4% (62) Other - 13% (184) Plate Damage 0.1% (2) Rental - 3% (43) Temp Tags (Out of State) 0.5% (7) Vehicle Mismatch 0.6% (8) Uncontrollable Errors: 28% (400) PCU Violations: Glare of Plate 0.5% (5) Multiple Vehicles - 8% (77) No Rear Plate -2 % (20) Not Found on MVA 12% (122) Obstructed Vehicle/Plate - 11% (102) Rental - 6% (56) Temp Tags (Out of State) - 0.3% (3) Vehicle Mismatch - 1% (10) Uncontrollable Errors: 40%

RLC Violations Glare of Plate 0.5% (15) No Rear Plate - 0.8% (23) Not Found on MVA 2% (67) Obstructed Vehicle/Plate - 2% (44) Rental - 1% (30) Temp Tags (Out of State) - 0.2% (6) Dealer Tags Out of State - 0.04% (1) Vehicle Mismatch - 0.1% (4) Uncontrollable Errors: 7% (190) PCU Violations Dealer Tags (Out of State) - 0.1% (1) Glare of Plate 1% (15) Funeral Procession - 0.1% (1) No Rear Plate - 2% (23) Not Found on MVA 5% (74) Obstructed Vehicle/Plate - 3% (46) Other - 0.1% (2) Rental - 3% (40) Temp Tags (Out of State) - 0.4% (6) Vehicle Mismatch - 0.3% (5) Uncontrollable Errors: 14%

RLC Violations Dealer Tags (Out of State) - 0.1% (1) Glare of Plate 1% (19) Funeral Procession - 1% (17) No Rear Plate - 1% (17) Not Found on MVA 3% (50) Obstructed Vehicle/Plate - 4% (63) Other - 0.8% (12) Rental - 2% (29) Vehicle Mismatch - 0.3% (5) Uncontrollable Errors: 15% PCU Violations Dealer Tags (Out of State) - 0.2% (2) Glare of Plate 2% (18) Multiple Vehicles - 8% (76) No Rear Plate - 3% (25) Not Found on MVA 13% (125) Obstructed Vehicle/Plate - 9% (93) Other - 0.2% (2) Out of Position - 11% (105) Rental - 12% (115) Temp Tags (Out of State) - 2% (19) Vandalism - 3% (34) Vehicle Mismatch - 1% (11) Uncontrollable Errors: 63%

Emergency Response - 0% (1) No Violation - 7% (38) Test-Shot - 4% (21) Non-Violations Canceled by Vendor by Reason and Location No violation occurred so canceled. Funeral procession, second speed below threshold, etc. Only LC 2054 only speed camera until 10/01.

No Violation - 3% (7) Test-Shot - 4% (10)

Emergency Response - 1% (1) No Violation - 32% (50) Test-Shot - 5% (8)

No Violation - 52% (89) Test-Shot - 6% (4)

Emergency Response - 3% (3) Test-Shot - 4% (4)

Emergency Response - 1% (1) Test-Shot - 5% (4)

Test-Shot - 2% (3)

Emergency Response 4% (4) Test-Shot 5% (5)

Emergency Response 0.6% (4) Test-Shot 0.5% (3) No Violation - 5% (8)

No Violation - 36% (24)

RLC Violations: Emergency Response - 3% (49) No Violation - 56% (796) PCU Violations: Emergency Response - 3% (29) No Violation - 2% (19) Test-shot - 6% (56)

RLC Violations: Emergency Response - 5% (61) No Violation - 62% (794) Test Shot 8% (99) PCU Violations: Emergency Response - 5% (38) No Violation - 2% (13) Test-shot - 12% (99)

RLC Violations Emergency Response - 2% (60) No Violation - 31% (875) Officer Present 3% (85) Duplicate Violation - 2% (65) PCU Violations Emergency Response - 4% (62) No Violation - 62% (898) Officer Present - 6% (85)

RLC Violations Emergency Response - 4% (63) No Violation - 62% (897) Officer Present - 6% (89) PCU Violations Emergency Response - 8% (79) Test Shot - 9% (93)

Vendor Cancellation Rate

Violations Canceled by Vendor/Total Violations captured should be 20% - 40%. Initial Analyst or 2nd Analyst cancels.

Total Events: 1676 Vendor Accepted: 1012 Percent Accepted: 60% Vendor Cancellation: 582 Percent Canceled: 35% Still Processing: 82 Percent Still Processing: 5%

Total Events: 532 Vendor Accepted: 280 Percent Accepted: 53% Vendor Cancellation: 230 Percent Canceled: 43% Still Processing: 22 Percent Still Processing: 4%

Total Events: 513 Vendor Accepted: 341 Percent Accepted: 66% Vendor Cancellation: 154 Percent Canceled: 30% Still Processing: 18 Percent Still Processing: 4%

Total Events: 569 Vendor Accepted: 367 Percent Accepted: 64% Vendor Cancellation: 172 Percent Canceled: 30% Still Processing: 30 Percent Still Processing: 6%

Total Events: 523 Vendor Accepted: 391 Percent Accepted: 75% Vendor Cancellation: 99 Percent Canceled: 19% Still Processing: 32 Percent Still Processing: 6% Discarded: 1 Percent Discarded: 0.1%

Total Events: 428 Vendor Accepted: 319 Percent Accepted: 75% Vendor Cancellation: 84 Percent Canceled: 20% Still Processing: 25 Percent Still Processing: 6%

Total Violations: 342 Vendor Accepted: 184 Percent Accepted: 54% Vendor Cancellation: 151 Percent Canceled: 44% Still Processing: 7 Percent Still Processing: 2%

Total Violations: 473 Vendor Accepted: 341 Percent Accepted: 78% Vendor Cancellation: 112 Percent Canceled: 26% Still Processing: 20 Percent Still Processing: 5%

Total Violations: 602 Vendor Accepted: 398 Percent Accepted: 66% Vendor Cancellation: 175 Percent Canceled: 29% Still Processing: 29 Percent Still Processing: 5%

Total Violations: 151 Vendor Accepted: 0 Percent Accepted: 0% Vendor Cancellation: 67 Percent Canceled: 44% Still Processing: 84 Percent Still Processing: 56%

Total RLC Violations: 3032 Vendor Accepted: 1493 Percent Accepted: 49% Vendor Cancellations: 1485 Percent Canceled: 49% Still Processing: 54 Percent Processing: 2% Total PCU Violations: 3217 Vendor Accepted: 2120 Percent Accepted: 66% Vendor Cancellation: 983 Percent Canceled: 31% Still Processing: 114 Percent Still Processing: 4%

Total RLC Violations: 2609 Vendor Accepted: 1309 Percent Accepted: 50% Vendor Cancellation: 1271 Percent Canceled: 49% Still Processing: 29 Percent Still Processing: 1% Total PCU Violations: 2999 Vendor Accepted: 1860 Percent Accepted: 62% Vendor Cancellation: 845 Percent Canceled: 28% Still Processing: 294 Percent Still Processing: 10% BPD Start Up Log Error: 1

Total RLC Violations: 2852 Vendor Accepted: 1085 Percent Accepted: 38% Vendor Cancellation: 1402 Percent Canceled: 49% Still Processing: 365 Percent Still Processing: 13% Total PCU Violations: 5534 Vendor Accepted: 2984 Percent Accepted: 54% Vendor Cancellation: 1420 Percent Canceled: 26% Still Processing: 1130 Percent Still Processing: 20% BPD Start Up Log Error: 1

Total RLC Violations: 2977 Vendor Accepted: 895 Percent Accepted: 30% Vendor Cancellation: 1446 Percent Canceled: 49% Still Processing: 636 Percent Still Processing: 21% Total PCU Violations: 5099 Vendor Accepted: 2684 Percent Accepted: 53% Vendor Cancellation: 992 Percent Canceled: 19% Still Processing: 1424 Percent Still Processing: 28% RLC Violations BPD Start Up Log Error: 0 (Site 6403)

# of times PCU was unable to setup properly

BPD not able to log into camera, can't take test shot, or verify equipment is working properly. Brekford usually gets them working by the afternoon on same day. Camera shuts down prematurely during the day, can't take test shot, etc. All events get discarded on a per camera per day basis.

BPD Start Up Log Error: 3

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0

BPD Start Up Log Error: 0 Brekford reported that the setup times were missing on the setup logs. BPD Close Out Log Error: 0

BPD Close Out Log Error: 5

BPD Close Out Log Error: 1

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

BPD Close Out Log Error: 1

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

BPD Close Out Log Error: 0

BPD Close Out Log Error: 1

BPD Close Out Log Error: 1

# of times PCU was unable to close out properly

RLC Violations BPD Close Out Log Error: 1

Vendor Accepts: 1012 BPD Rejects: 48 Percent Reject: 5% BPD Rejection Rate Violations Rejected by BPD/Total Violations Accepted by Vendor; should be under 5%.

Vendor Accepts: 280 BPD Rejects: 4 Percent Rejected: 1%

Vendor Accepts: 341 BPD Rejects: 33 Percent Rejected: 10%

Vendor Accepts: 367 BPD Rejects: 10 Percent Rejected: 3%

Vendor Accepts: 391 BPD Rejects: 32 Percent Rejected: 8%

Vendor Accepts: 319 BPD Rejects: 13 Percent Rejected: 3%

Vendor Accepts: 184 BPD Rejects: 6 Percent Rejected: 3%

Vendor Accepts: 341 BPD Rejects: 20 Percent Rejected: 6%

Vendor Accepts: 398 BPD Rejects: 44 Percent Rejected: 11%

Vendor Accepts:0 BPD Rejects: 0 Percent Rejected: 0%

RLC Violations: Vendor Accepts: 1493 BPD Rejects: 103 Percent Rejected: 7% PCU Violations: Vendor Accepts: 2120 BPD Rejects: 26 Percent Rejected: 1%

RLC Violations Vendor Accepts: 1309 BPD Rejects: 148 Percent Rejected: 11% PCU Violations Vendor Accepts: BPD Rejects: 95 Percent Rejected: 13% RLC Violations Clarity of Plate: 94 Cropped Vehicle: 2 Dark Environment: 4 Data Bar Error: 1 Duplicate Violations: 5 PCU Violations Clarity of Plate: 55 Dark Environment: 5

RLC Violations Vendor Accepts: 1085 BPD Rejects: 39 Percent Rejected: 4% PCU Violations Vendor Accepts: 2984 BPD Rejects: 125 Percent Rejected: 4% RLC Violations Clarity of Plate: 10 Data Bar Error: 1 Out of Position: 1 PCU Violations Clarity of Plate: 47 Dark Environment: 4

RLC Violations Vendor Accepts: 895 BPD Rejects: 116 Percent Rejected: 13% PCU Violations Vendor Accepts: 2684 BPD Rejects: 176 Percent Rejected: % RLC Violations Clarity of Plate: 31 Dark Environment: 17 Duplicate Violation: 10 Data Bar Error: 1 PCU Violations Clarity of Plate: 40 Dark Environment: 14 Duplicate Violation: 2 RLC Violations Funeral Procession: 1 Glare of Plate: 27 Other: 26 PCU Violations Glare of Plate: 26 Multiple Vehicles: 83 Obstructed Vehicle/ Plate: 5 Other: 4

Clarity of Plate: 25

Clarity of Plate: 2 Dark Environment: 2

Clarity of Plate: 20

Clarity of Plate: 5

Clarity of Plate: 24 Dark Environment: 4 Site Error: 1

Clarity of Plate: 7

Clarity of Plate: 5

Clarity of Plate: 13 Dark Environment: 1

Clarity of Plate: 38 Dark Environment: 2 Cropped Vehicle: 1

None.

RLC Violations: Clarity of Plate: 52 Cropped Vehicle: 2 Dark Environment: 3 PCU Violations: Clarity of Plate: 16

Controllable Violations Rejected by BPD by Reason and Location

Citation should have been issued but wasnt due to vendor. Equipment malfunction; not sent to BPD in time, etc. LC 2054 only speed camera until 10/01.

DOT Uncontrollable Violations Rejected by BPD by Reason and Location Citation should have been issued but wasnt, not due to vendor. Multiple vehicles in image, info not found at MVA, etc. LC 2054 only speed camera until 10/01.

Glare of Plate: 5 Multiple Vehicles: 11 Obstructed Vehicle/Plate: 5 Stolen Plate: 1

Glare of Plate: 3 Multiple Vehicles: 10

Glare of Plate: 1 Multiple Vehicles: 4

Glare of Plate: 2 Multiple Vehicles: 1

Glare of Plate: 4 Multiple Vehicles: 1 Obstructed Vehicle/Plate: 1

Glare of Plate: 1

Glare of Plate: 5 Obstructed Vehicle/Plate: 1

Glare of Plate: 1 Obstructed Vehicle/Plate: 2

None.

RLC Violations: Glare of Plate: 30 Incorrect Vehicle: 1 Multiple Vehicles: 3 Obstructed Vehicle/Plate: 2 Other: 5 Vehicle Mismatch: 1 PCU Violations: Glare of Plate: 7 Multiple Vehicles: 6 Other: 7

RLC Violations Glare of Plate: 11 Multiple Vehicles: 3 Other: 8 Vehicle Mismatch: 1 PCU Violations Glare of Plate: 16 Multiple Vehicles: 40 Obstructed Vehicle/ Plate: 3 Other: 1

RLC Violations Glare of Plate: 19 Multiple Vehicles: 2 Obstructed Vehicle/ Plate: 1 Other: 1 PCU Violations Glare of Plate: 16 Multiple Vehicles: 45 Obstructed Vehicle/ Plate: 3 Other: 7

No Violations: 1 Non-Violations Rejected by BPD by Reason and Location No violation occurred so canceled. Funeral procession, second speed below threshold, etc. LC 2054 only speed camera until 10/01.

None.

None.

None.

None.

None.

None.

None.

None.

None.

RLC Violations: Emergency Response: 2 No Violation: 2 PCU Violations: No Violation: 1

RLC Violations: Emergency Response: 2 No Violation: 8 PCU Violations: Emergency Response: 2

RLC Violations Emergency Response: 2 No Violation: 2 PCU Violations Emergency Response: 3

RLC Violations No Violation: 3

Issues were noted with loca on of reference lines moving. Also, some vehicles appearing to be out of position (early triggers). Brekford rereviewed and did cancellations after URS brought these issues to their attention. URS noted the following issues from a review of printed citations: 19700681 - Back-Side of citation is missing 19999184 - Clarity of Plate Issue 19999887 - Clarity of Plate Issue 19999895 - Clarity of Plate Issue 19999382 - Unable to Identify Make of Vehicle 19702489 - Unable to Identify Make of Vehicle DOT Voids - Total Total citations voided or recommended for voiding by DOT/URS.

A few violations appeared to have early triggers sent back to Brekford to re-review. URS noted the following issues from a review of printed citations: 19998731 - Digital Line is not Aligned Properly 19999432 - Unable to Identify Make of Vehicle 19703735 - Clarity of Plate Issue and Unable to Identify Make of Vehicle 19703727 - Clarity of Plate Issue and Unable to Identify Make of Vehicle 19703461 - Unable to Identify Make of Vehicle 19703669 - Unable to Identify Make of Vehicle 19705235 - Another Vehicle Entered Radar Zone. 19705383 - Unable to Identify Make of Vehicle 19704840 - Clarity of Plate Issue 19705532 - Clarity of Plate Issue 19705367 - Clarity of Plate Issue

A few images appear to be dark and/or clarity of plate a concern - Brekford to reassess. URS noted the following issues from a review of printed citations: 19705953 - Clarity of Plate Issue 19706183 - Clarity of Plate Issue

URS noted issues with clarity of plate still URS noted that there were a few concerns with clarity of plate. Brekford said they would remain. One Citation was discared for being "out of date". re-review. Quantity of citations in queue remains inconsistent - only provided 46 on 8/14, no others provided.

Clarity of Plate issues remain a concern. 4 voided cita ons by DOT (19700681, 19998731, 19998624, 19999242) should not have been issued.

BPD had difficulty closing log out on 09/05/13, and could not close out the log on 09/06/13. Brekford slow to respond.

No issues to report

URS noted the following concerns: 9/20/2013 : Rejections BC163084 Appears clear and no need for rejection BC163548 Appears trailing vehicle too close BC163831 Appears clear and no need for rejection BC163821 Appears clear and no need for rejection BC163817 Appears clear and no need for rejection 9/17/2013 : BC167281 is Blurry, BC167290 Glare of Plate BC167299 Glare of plate, BC167720 Clarity of Plate BC167721 Clarity of Plate, BC167722 Clarity of Plate BC167724 Clarity of Plate, BC167724 Clarity of plate BC167736 Clarity of Plate, BC167737 Obstructed Plate BC167740 Clarity of Plate, BC167741 Clarity of Plate BC167744 is slightly blurry Rejections BC163672 - Not sure why it is a site error 9/16/2013 : BC167149 is blurry, BC167150 is blurry, BC167151 i bl BC167162 j t d t

URS noted the following concerns: 9/24/2013: BC168984 Plate obstructed and blurry BC168986 Clarity of Plate BC168989 Glare of Plate BC169178 Glare of Plate BC169180 Glare of Plate BC169182 Glare of Plate BC169191 Glare of Plate BC169197 Glare of Plate BC169200 Glare of Plate BC169207 Obstructed Plate/ Clarity of Plate NOTE: There were no citations processed 9/25 through 9/27.

Speed Camera Review 10/7/2013 1. Recommend reject 2 for Equipment Malfunction (172800, 172930). 2. Recommend Reject 2 due to Dark Environment (172814, 172816). 3. Vehicle appears to be braking but speed increased in second picture in 5 (172871, 172872, 172934, 172943, 172944). 4. Recommend Reject 9 due to Clarity of Plate (173038, 173057, 173085, 173103, 173112, 2. Some violations reviewed on 10/2 are showing 172794, 172820, 172789, 173113). two reference lines. Brekford has been cancelling 5. Recommend reject 6 due to Obstructed Vehicle/Plate (172894, 173034, 172787, otherwise valid violations due to the second line 172788, 173105, 173135). showing. The cancellations due to multiple Red Light Review 10/8/2013 reference lines are being categorized as "Other", should be recorded as Equipment Malfunction. Rejections 1. No Violation - Not clear why rejected for 3 3. Brekford does not yet have Site Books available (170383, 172130, 171790). 2. Clarity of Plate instead of Glare of Plate for the Operators to use while processing (169336). violations. They have said they are working on 3. Plate is readable and no need for rejection for these. 19 (170195, 170154,, 170840, 4. There were no citations provided to URS in the 170433,171020, 171388, 172055, 172053, 172017, 171612, 172067, 174011, 175676, DOT Consultant Queue to review this week, therefore there are no citations to report concerns 175574, 175331, 171930, 172617, 174731, 176065). on. 4. 173982 - Are Dodge Ram trucks listed at the MVA as RAM? Speed Camera Review 10/10/2013 (scroll d ) 1. Questions about acceptable vehicle distance from reference line. Supervisors said anything 5feet beyond reference line should be cancelled as "Out of Position". Small distances are difficult to discern from the photos, making these tough judgment calls. The Business Rules define Out of Position as vehicle is not within one car length of the correct position according to the Positioning Guide.

Speed Camera Review 10/14 - 153 Citation and 50 Comments/Potential Rejections 1. Site 1483: no test shot, 60 events canceled as "Equipment Malfunction". 2. Recommend reject 39 due to Clarity of Plate (180838, 181613, 181624, 181716, 181726, 181743, 182062, 182108, 182150, 182183, 182243, 182544, 182545, 182651, 182658, 182686, 182672, 182743, 182881, 182937, 183032, 183109, 183121, 183180, 183181, 183183, 183204, 183211, 183214, 183228, 183230, 183267, 183848, 183849, 183909, 184109, 184139, 184144, 184146). 3. There were 2 citations we would reject b/c vehicles appear to be braking but speed increased b/t images A and B (182829, 183994). 4. Recommend reject 5 due to Obstructed Vehicle/Plate (182649, 181539, 182957, 181624, 183248). 5. Recommend 4 rejections due to weather conditions (183920, 183959, 183976, 184107). 6. One citation where the camera triggered early (183892). General Comment: Sites are not consistent with where the pictures are triggered to be taken. Varies for every site. Red Light Review 10/14 - 76 Citations 1. There were 8 citations we would reject due to Clarity of Plate issues (182484, 182459, 183320, 183323, 183330, 183337, 183649, 183755) Speed 10/15 - 49 Citation (scroll down) 1 V hi l t b b ki b t di d

Equipment Malfunction 1. DOT to disregard all the citations from 6403 on 10/22. No test shot came back from the closing so no log was completed. Speed Review 10/23 1. Recommend reject 16 due to Clarity of Plate (190022, 192633, 192635, 192687, 192721, 192723, 192728, 192738, 192740 192748, 192751, 192771, 192789, 192851, 194564, 194567). 2. Recommend reject 3 due to Obstructed Vehicle/Plate (193678, 187762, 193806). 3. Recommend reject 4 due to Glare of Plate (193867, 193693, 192773, 193779). 4. Recommend reject one due to Dark Environment (193697). 5. Recommend reject one due to Multiple Vehicles (194574). Speed Review 10/24 (196 Citations) 1. Reject 4 due to Clarity of Plate (197259, 197258, 197213, 194704). 2. Reject 3 due to Dark Environment (197201, 194884, 194924). 3. Reject one due to Glare of Plate (194668). 4. Reject 8 due to Out of Position (194828, 194832, 194854, 194855, 194857, 197019, 195098, 197063). 5. Reject one due to Emergency Vehicle with strobe lights on (195025). 6. Reject 4 due to brake lights on in both images with no decel in speed (197017, 196945, 195098, 194686). Red Light Review 10/25 (49 Citations) 1. Reject one due to Clarity (199469). 2. Reject one due to Glare (199157). 3. Reject two due to Dark Environment (198946, 199382). Red Light Rejection Review 10/25 (20 Citations) 1. Accept 10 as legible, Not Clarity issues (197662, 196551, 196536, 196508, 196511, 196561, 196562, 191187, 196510, 193476). 2. Accept one as violation, the light appears red prior to vehicle passing stop bar (197672). Speed Review 10/25 (273 Citations) 1. Reject 2 due to Clarity (197334, 200167). 2. Reject 2 due to Multiple Vehicles (200119, 200095). 3. Reject 3 due to Brake Lights on in both images with no decel in speed (197834, 197864, 200104). 4. Reject 3 due to Out of Position (200021, 199851, 199703). Speed Rejection Review 10/25 (12 Citations) 1 A t 4 l ibl N Cl it i (194796 195080 195131 196876)

Voids by Reason

Total Voided Citations by Reason; Under Investigation (UI) Not testing UI codes until September per DOT-IT. Not testing UI codes until September per DOT-IT. Not testing UI codes until September per DOT-IT. Not testing UI codes until September per DOT- Not testing UI codes until September per DOT- Not testing UI codes until September per DOT- Not testing UI codes until September per DOT- Not testing UI codes until September per DOT- Not testing UI codes until September per DOT-IT. Not testing UI codes until September per DOT-IT. UI codes testing date TBD. IT. IT. IT. IT. IT. codes: Stolen Vehicle (SV), Stolen Tags (ST), Owner Death (OD), Funeral Procession (FP), Bankruptcy (BR), Official Police Business (PD), Rental/Lease Exemptions (RE), Voided by DOT (VD) No files transferred in the 1st week. 2nd week 343 citations had to be discarded in the test run data showed some errors in content and format. because the batch of citation #s was incorrect. That problem has been corrected. All 116 citations rejected on 08/09/13. Unable to Unable to get updates all week due to IT issues. No data transfers, possibly due to get updates for the rest of the week due to IT DOT-IT not downloading citation data from issues. No other data transfers, possibly due to ftp site. DOT-IT not downloading citation data from ftp site.
08/21 Error Report (PF 690), no errors but only 10 citations. 08/22 Error report (PF 690) by MOIT not complete (just a summary) but no errors, but only 39 citations.

UI codes testing date TBD.

UI codes testing date TBD.

Not testing UI codes per DOT-IT. Testing date TBD.

MOIT/ DOT-IT

# of errors in daily data uploads from Vendor.

# of citations that failed to upload to MOITs mainframe per day (bounced out). Vendor needs to resubmit those within 1 day.

No data transfers possibly due to DOT-IT Chief leaving City.

No data transfers possibly due to DOT-IT changes in staffing.

No data transfers possibly due to DOT-IT changes in staffing.

0 error transfers out of 598 on 09/24. On 09/26 PF 690 Error Report showed 0 errors out of 1168 DOT-IT realized they were not sending citation citations from file transferred on 10/04. data to MOIT during Test Run. 39 error transfers DOT-IT reported that Brekford has not been out of 1553 reported by MOIT on 09/18. 0 error transmitting the citation data files to DOT every day, just periodically. Brekford was asked about it transfers out of 245 on 09/20. but did not respond.

No citation data files transferred this week from Brekford.

10/18 - 463 errors out of 4,567 citations. Brekford sent questions to DOT. MOIT to respond.

# of discrepancies in data sets between MOIT and iP360. Metric

Dummy files during Test Run. Check every week. Problem Not checked by DOT-IT. in the past with openbaltimore data. Description; Comments Latest Business Rules not yet finalized. URS using version provided 4/12/13.

Not checked by DOT-IT.

Not checked by DOT-IT.

Not checked by DOT-IT.

Not checked by DOT-IT.

Not checked by DOT-IT.

Issues Monitored During Test Run


Latest Business Rules not yet finalized. URS using Latest Business Rules not yet finalized. URS using Latest Business Rules not yet finalized. URS version provided 4/12/13. version provided 4/12/13. using version provided 4/12/13. Business Rules Provided - Rejection Codes appear to match URS noted no issues with Rejection Codes URS noted no issues with Rejection Codes URS noted no issues with Rejection Codes URS noted no issues with Rejection Codes URS noted no issues with Rejec on Codes Revised Business Rules Provided 9/27 Some Rejec on Codes missing in iP360. URS did a comparison of rejec on codes in iP360 against those in the revised Business Rules, and had the following comments: 1. "Time Stamp" not available on Operator's list of Rejection Codes. 2. "Error - Operator" not available on Operator's list. Could only be available to DOT/BPD? 3. "Discarded Violation" not available on Operator's list. Rules state that it's only to be available to BPD. 4. "Plate Damaged" shows as "Plate Damage" for Operators. 5. "Test Shot" shows as "Test-shot" for Operators. 6. "Temporary Tags (out of state)" shows as "Temp Tags (out of state)" 7. "Glare On Plate" shows as "Glare of Plate" 8. All other Rejections Codes are present and displayed correctly Revised Business Rules Provided 9/27 PDF conversion of citations in iP360 is working properly Citations are cast in stone; same in iP360 as print out. DOT verifies. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. PDFs are not being modified. DOT noted that on Red Light Camera citations dated between 10/7 and 10/11 reference numbers on iP360 are not matching the citation numbers printed on .pdfs. This occurs on both in-state and out-of-state citations. BPD and URS do not have the following rejection codes that are listed in the Business Rules: "Error - Operator" not available "Discarded Violation" not available 1. Rejection code issues noted 10/4 and 10/18 have not been addressed.

Rejection Codes in iP360 match the ones in the latest Business Rules.

DOT verifies.

Is iP360 working properly?

Data is complete and accurate; new version (3.0) is working properly; able to handle test run; rolling right data is separated from straight through; separate test run data from real data. Vendor isn't making any changes to the data or purging any data. iP360 has been under development since program began.

Vendor is working with BPD to address Closeout Log Issues. URS also experienced some issues with accessing iP360 and quantity of citations provided for review was inconsistent. URS does not have access to violations cancelled by Brekford. Problems with BPD Supervisor Queue to view rejected violations - shows zero in queue.

Vendor is working with BPD to address Closeout Log Issues. There were issues identified with Brekford providing adequate access to URS for timely QC checks before BPD review. URS does not have access to violations canceled by Brekford. S ll problems with BPD supervisor queue.

Issue of 1 voided citation that was found missing in ip360 came up. Vendor will investigate how many vendor voids are missing from ip360. Vendor will also look into capturing voids on ip360. URS does not have access to violations canceled by Brekford. S ll problems with BPD supervisor queue.

Brekford said data will not be purged anymore from iP360. No violations to review in iP360 for 2 days this week due to iP360 program issues (resolved by Brekford on 08/14/13). URS does not have access to violations canceled by Brekford. Still problems with BPD supervisor queue.

URS does not have access to the canceled violations. Problems with BPD Supervisor Queue to view rejected violations.

URS nally got access to the canceled violations. Problems with BPD Supervisor Queue to view rejected violations. Brekford updated iP360 again on 08/23/13 (see release notes). BPD noted a glitch in iP360 w/ RL cita ons repeating (fixed by Brekford on 09/10/13).

URS review of rejec on codes is working capably. BPD noted a glitch in iP360 w/ RL cita ons repeating (fixed by Brekford on 09/10/13). Glitch with incorrect viola on speed in Setup and End Logs. DOT couldnt view the PDF cita ons in iP360 on 09/03. Brekford fixed it on 09/04.

URS review of rejec on codes is working capably. Brekford "updated" iP360 again on 09/10. BPD Supervisor Queue s ll not working properly. BPD had problem approving RL cita ons due to glitch in iP360. Brekford said b/c they were updating iP360 at that time. CAV reports a glitch in the iReport module on 09/11. Brekford resolved it on 09/12. URS reports a very low # (49) of processed citations in iP360 this week and none had PDFs, only images.

URS review of rejec on codes is working capably. URS reported data glitches in iP360 this week. CAV reported glitch in iP360 on 09/16 - reject #'s dont match, can't view citations or videos. Brekford fixed on 09/16. Reject #'s dont match in iProcess on 09/17. DOT couldn't open cita ons in iManager on 09/18. Brekford said due to City's internet service provider but doubtful b/c rest of iP360 was fine. Citations viewable on 09/19.

URS review of rejec on codes is working capably. URS noted issues with Viola on Data in iREPORT - It appears that on occasion cancellation data for red light cameras is included with speed cameras. Recommend these data sets be kept separate for tracking purposes. URS is not sure what triggers the red light camera to sometimes appear in the speed camera data reports. Brekford "updated" iP360 again on 09/27. Equipment Asset Report not in iP360 on 09/24. Reports not able to be produced in iP360 on 09/24.

Vendor

URS noted again, issues with Viola on Data in iREPORT - cancellation data for red light cameras is intermittently included with speed cameras. Given the an cipated larger volume of cita ons that will need to be reviewed, would it be possible for Brekford to keep violations in the DOT Consultant review queue for at least a full 24 hrs, rather than the current 8-12 hrs? We could use more time to review more of the citations, especially if new citations aren't provided until the afternoon. - DOT said no, didn't want to hold up Brekford any. Some Site Books are missing in iP360. BPD had to no fy Brekford 3 mes to correct the login information for the new officers so they could work. Rejec on #'s in iP360 some mes don't match in iProcess. URS reported that RL videos not in iP360 un l 10/04. URS reported that RL cancella on data shows up in the speed data reports many times.

1. BPD has been experiencing issues with the spikes in Approval queue data and will keep an eye on the DOT Consultant queue for similar spikes. 2. The camera 1151 at Guilford and Federal was not operation on 10/9. 3. BPD is not able to open the citations in iP360 from time to time. Legal had the same problem once. Most of the time it is fine but this problem keeps reoccurring. I think it is iP360 because I can navigate fine in the different modules all the time. But every once in a while I cant open the citations. Brekford keeps saying its due to our internet service provider or that we have slow computers. 4. iP360 was "updated" by Brekford on 10/05 to correct a Time Stamp issue in the System Check. 5. URS and BPD reported that the queues have been filled up inconsistently in iP360. Brekford says due to MVA. 6. BPD reported that when they notify Brekford that they can't take a test shot the pic comes back 40 mins later w/ the wrong time on it.

1. Site 6403 was shut down due to a lack of test shot on 10/14. 1. DOT discovered that citation reference numbers in iP360 do not match the citation numbers being printed 2. DOT, BPD, and Legal have noted repeated problems with opening citations in iManager in iP360. This issue only happens from timeon citations. There were several citations, both in-state to-time, but continues to happen. Brekford says it's an issue with the ISP or the computers the city is using. and out-of-state with this issue. Most were dated between 10/7 and 10/11 on Red Light citations. 2. There are many citations that have a 20 day difference between the violation date and mailed by date which is not allowed by law for in-state violations. The problem appears to exist on both red light and speed citations with violation dates from 10/01 through 10/07. Brekford notified DOT about this. All will be voided. 3. BPD reported that Brekford did a good job at filling up the queues consistently all week. 4. Brekford has "updated" iP360 3 times in October and 9 times since August 23rd. iP360 is still under development.

Queues are being filled up. Queues in iP360 are properly filled

Queues are filled up inconsistently.

Queues are filled up inconsistently.

Queues are filled up inconsistently.

Queues are filled up inconsistently.

Queues are filled up inconsistently.

Queues are filled up inconsistently. No citations provided to URS on 09/3/13.

No issues reported.

No issues reported.

No issues reported.

Queues listed in Business Rules. BPD verifies.

There were no serious issues with queues, however they 1. There were no serious issues with queues, however they remain inconsistent on the time and quantity that are posted. Brekford says As noted above, DOT Consultant Queues were not There were no citations provided in the DOT this is all just related to how quickly violations can be processed and approved. Consultant queue for either red light or speed on remain inconsistent on the time and quantity that are filled for this week. Brekford did not have any posted. Brekford says this is all just related to how accepted violations to provide until the following Wed., 10/09. quickly violations can be processed and approved. week.

N/A Reports are generated accurately All reports are done properly and on time including the monthly report in SHAs format. DOT verifies. Not approved yet. Using previous template.

No report submitted by Brekford.

No report submitted by Brekford.

No report submitted by Brekford.

No report submitted by Brekford.

No report submitted by Brekford.

Data reports finally submitted by Brekford this week.

No report submitted by Brekford

Brekford did not submit 4 data reports that were No report submitted by Brekford due on 09/16. Brekford submitted them on 09/23. Not approved yet. Using previous template. Citation template approved by state this week. Brekford will use new template in October. URS has not received Monthly QA Report, TPA Log Reports, or Maintenance Reports from Brekford. Brekford reminded on 09/10/13 to provide all 3 to DOT but has not submitted anything.

Reports submitted by Brekford but incomplete.

Reports still incomplete. Brekford said they would have Data reports still incomplete but Brekford submitted PCU settings, Asset Mgmt report, TPA all reports finalized by the last week of October. report, radar certs, and their field checklists to DOT this week. Not approved yet. Using previous template. Not approved yet. Using previous template.

No report submitted by Brekford

Updated citation template is being used.

Not approved yet. Using previous template.

Not approved yet. Using previous template. No issues reported

Not approved yet. Using previous template. No issues reported

Not approved yet. Using previous template. URS not yet provided with Monthly QA Report. URS also has not seen Transaction Processing Agent (TPA) logs or Maintenance Reports by Brekford.

Not approved yet. Using previous template. URS has not received Monthly QA Report, TPA Log Reports, or Maintenance Reports from Brekford.

Not approved yet. Using previous template. URS has not received Monthly QA Report, TPA Log Reports, or Maintenance Reports from Brekford.

Not approved yet. Using previous template.

Not approved yet. Using previous template. URS has not reviewed Monthly QA Report or TPA logs.

Not approved yet. Using previous template.

All vendors SOPs are being properly followed.

Consultant on site to oversee vendors operations.

No issues reported Vendor changed camera alignment during maintenance work. This caused misalignment in the report lines and camera shut-down on 7/25/13 afternoon. DOT has informed vendor to re-verify all camera settings after all maintenance activities on the camera in accordance to the established SOP. No issues reported. No issues reported.

URS has not received Monthly QA Report, TPA URS has not received Monthly QA Report, TPA Log Reports, or Maintenance Reports from Log Reports, or Maintenance Reports from Brekford. Brekford reminded on 09/10/13 to Brekford. Brekford reminded on 09/10/13 to provide all 3 to DOT but has not submitted provide all 3 to DOT but has not submitted anything. anything.

URS has not reviewed Monthly QA Report or TPA URS was provided TPA reports and Maintenance reports. URS was provided TPA reports and Maintenance reports. These are currently under review and comments to DOT will be provided ASAP. logs. These are currently under review and comments to DOT will be provided ASAP.

No issues reported.

Processing rate is uniform.

No lopsided huge mass processing in one day. DOT verifies. N/A yet. Brekford has been communicating better with DOT. N/A yet. Brekford has been communicating better with DOT. N/A yet. DOT found 1 (real) citation (TR) that was missing in ip360. Vendor will investigate how many vendor voids are missing from ip360.

Quantity of violations in queues are inconsistent.

No issues reported.

No issues reported.

No issues reported.

No issues reported.

No issues reported.

No issues reported.

URS and BPD reported that the queues are filled URS and BPD reported that the queues are filled up inconsistently. Brekford Processors averaged up inconsistently. Brekford Processors are averaging approximately 640 speed violations and 544 speed violations and 489 red light violations per day. 590 red light violations per day. N/A yet. Brekford changed the name of the data files without notifying DOT-IT and modified the location description at LC4493 without approval. N/A yet. Brekford has been making an effort to communicate better with the City but some improvements with communication are still needed. 1 box of citations delivered on 10/08.

The queues were consistently filled this week. Brekford Processors averaged 872 speed violations and 497 red light violations per day. N/A yet. 1. Brekford took 4 months to relocate PCU LC 1031 to the median after directed to by DOT back in June. 2. Brekford reported that they need to reposition the report line at 2 PCUs. They coordinated with the City properly before doing so.

No significant issues reported. Brekford Processors averaged 758 speed violations and 483 red light violations per day for the week.

iCourt has documents as 1 PDF per case

DOT verifies.

N/A yet. No issues reported.

N/A yet. No issues reported.

N/A yet. No issues reported.

N/A yet. Brekford slow to respond on issues sometimes.

N/A yet. Brekford was notified that they need to respond quicker to the City.

N/A yet. No issues reported.

N/A yet. No issues reported.

N/A yet. No issues reported.

No changes are made without DOT approval.

Maintain proper communication with the client.

All citations are mailed to DOT before the mail dates. iP360 to reflect data by the next morning.

Complied. Deliver to DOT by 13th day from violation date for in state, 29th day for out of state. DOT verifies.

Delay due to invoice. Delivered to DOT on 08/22/13.

Delay due to invoice. Delivered to DOT on 08/22/13.

Delay due to invoice. Delivered to DOT on 08/22/13.

DOT received a box of citations on 08/22/13 for citations up to 08/18/13. Delay was due to invoice approval.

No citations delivered to DOT this week.

No citations delivered to DOT this week.

No citations delivered to DOT this week. Brekford Brekford sent a batch of printed citations to DOT 1 box of citations delivered on 10/03. Brekford sent a batch of printed citations to DOT on 09/13/13. Still not sending to DOT on has been reminded to send citations to DOT on a on 09/26/13. Still not sending to DOT on a daily basis. daily basis. a daily basis.

No citations delivered to DOT this week. 1 box of citations delivered on 10/15. 4 boxes of citations delivered on 10/16. 1 box of citations delivered on 10/18.

All City's SOPs are being properly followed. Problems with closing down cameras several times (violations discarded those days). Problem se ng up one camera on 3 dierent days (Brekford setup in afternoon). Access problems in iP360. URS no ced reference lines moving and some early triggers. URS does not have access to the canceled violations in iP360. Other data transfer issues were reported by IT. BPD Supervisor queue not working in iP360. High controllable error rate. Problem with closing down camera one day violations discarded; 343 citations (4 days worth) had to be discarded since they failed to transfer to City's mainframe due to citation #'s being incorrect; There were some more violations with early triggers; Reference lines still not fixed; URS does not have access to the canceled violations in iP360; BPD Supervisor queue not working in iP360; High controllable error rate.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Is the ATVES Program running error free?

Note any significant issues.

DOT

N/A, beginning of Test Run.

URS queue fixed.

Issues resolved

Brekford printed a batch of RL citations without approval from DOT (no submittals for checklist). Didn't follow SOP for checklist procedure Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs. Clarity of some images remain a concern and URS noted consistent image quality problems during the dusk and dawn hours Brekford working on a solution. URS reported that only about 50% of trac data was caught in both PCUs when sthey were setup side by side. Brekford "updated" iP360 again this week on 09/10. BPD couldn't open or close PCU on 09/09. Brekford slow to respond both times but finally did. Many dark shots s ll. PCUs dont have flashers. Brekford was no ed that they need to respond quicker to the City. BPD had problem approving RL cita ons due to glitch in iP360. Brekford said b/c they were updating iP360 at that time. BPD Supervisor Queue not working on RL side. CAV reports a glitch in the iReport module on 09/11. Brekford resolved it on 09/12. Brekford printed a batch of RL cita ons without approval from DOT (no submittals for checklist). Didn't follow SOP for checklist d No startup or close out problems this week. iP360 glitch was resolved on 08/14/13. No startup problems with PCU this week. No startup or close out problems with PCU URS nally got access to the canceled Reference lines have been xed - Brekford is Brekford nally submi ed data reports this Glitch with incorrect enforcement speed in violations in iP360. welding brackets to the trays (in all PCUs) to No startup or close out problems with PCU this week. setup and end logs has been fixed. No startup or close out problems with PCU week. DOT had some comments. stabilize the trays. this week. this week. Access problems in iP360 appear to have been Good controllable error rate 4 weeks in a fixed. row. No starteup or close out problems with PCU this week. Controllable Error Rate much be er. Some issues with clarity of images. Data transfer issues were reported by IT. BPD supervisor queue not working in iP360. DOT found out that Brekford had deleted citations in iP360 that were issued when we were live. Brekford never informed DOT how many. URS does not have access to the canceled violations in iP360. iP360 not working properly for 2 days this week due to glitch in program. Qu antity of citations in queue is inconsistent. BPD supervisor queue in iP360 not working. URS does not have access to the canceled violations in iP360. Some #'s appear to be changing in iP360 such as BPD rejections. BPD supervisor queue in iP360 not working. Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs. URS does not have access to the canceled violations in iP360. Clarity of plate issues s ll remain. Some BPD rejects appear to be valid. BPD supervisor queue in iP360 not working. BPD noted a glitch in iP360 w/ RL cita ons repeating (Bkfd fixed on 09/10/13). Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs. Clarity of some images remain a concern and URS noted consistent image quality problems during the dusk and dawn hours Brekford working on a filter. Brekford updated iP360 (again) on 08/23. DOT no ced that BPD had rejected some valid citations during the Test Run - retraining needed. DOT cita on review - detatch lines misaligned, citation 19700681 has blank back side, 3 questionable citations should not have been issued (19998731, 19998624, 19999242). Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs. Clarity of some images remain a concern and URS noted consistent image quality problems during the dusk and dawn hours Brekford working on a solution. BPD couldn't close down PCU on 09/06 and was having trouble on 09/05 - Brekford slow to respond. BPD couldnt setup PCU on 09/03. Brekford fixed it by 7:30 am. Glitch with incorrect viola on speed in Setup and End Logs.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Yes. Need to update the Business Rules.

Brekford updates some SOPs. Overall they look good. Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs; There appears to be some confusion remaining about how and when certain rejection codes should be used (specifically, other, equipment malfunction, out of position). Posi oning Guides and Site Books need to be provided to the Processors to help their review efficiency and accuracy. DOT no ced that RLC LC 3073 had wrong location description and notified all agencies and Brekford. Brekford canceled these citations that were in the queue. Many people at DOT, Law, and BPD reported intermittent problems opening up citations in iP360. Brekford says due to City's internet service provider. 8 RL cita ons should not have been issued due to special event. Brekford modied the loca on descrip on at LC4493 and 4494 on citations and data bar without approval. Shows differently on iP360 than on citation. DOT-IT reported that Brekford changed the name in a data file without notifying them. A couple of incorrect speed readings were found but not processed.

Brekford has not followed some of the SOPs regarding relocating equipment and swapping out radars (LC1112 & 3012).

Brekford is getting better at following the SOPs.

URS for reviewing revised SOPs

Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs. Clarity of some images remain a concern and URS noted consistent image quality problems during the dusk and dawn hours - Brekford working on a solution. URS reported data glitches in iP360 this week. BPD Supervisor Queue not working on RL side. CAV reported glitch in iP360 on 09/16 - reject #'s dont match, can't view citations or videos. Brekford fixed on 09/16. Reject #'s don't match in iProcess on 09/17. Brekford submi ed 4 data reports 1 week late. Brekford did not sign their eld checklist before activation. Checklist submitted to DOT 1 month late. Brekford running out of cita on #'s. DOT-IT coordinating with MOIT. Brekford s ll pu ng 'BC' before all cita on #'s on printed citations. They have been told repeatedly for months not to do this anymore. Detach lines s ll misaligned on printed citations. Brekford informed mulitple times. Several speed cita ons show a slight report line misalignment (digital lines not parallel). There are no RL videos from the front cameras in iP360 or on test website for public. Brekford did not respond about why not. No startup or close out problems this week. DOT found 3 speed cita ons issued to large vehicles that appear valid.

Brekford hasn't submi ed QA Monthly Report, Data Reports, Maintenance Reports, or TPA logs. Clarity of some images remain a concern and URS noted consistent image quality problems during the dusk and dawn hours. BPD Supervisor Queue not working on RL side. Brekford "updated" iP360 again on 09/27. Equipment Asset Report not in iP360 on 09/24. Reports not able to be produced in iP360 on 09/24. Dark shots iden ed in iP360 that had to be canceled. Brekford moved PCU back to original loca on on 09/24. Out of commission until 10/01. Brekford reported on 09/26 that DOTs p site is full and can't transger info. DOT-IT working on getting more capacity. On 09/26 DOT-IT reported that Brekford has not been transmitting the citation data files to DOT every day, just periodically. Brekford was asked about it but did not respond.

No startup or close out problems this week.

1. We've noticed that locations with sag curves, vehicles appear to be braking (all three brake lights are clearly lit in both Image A and Image B); however, the vehicle speed is shown as increasing between Image A and Image B. 2. Noted that, as per Business Rules, a vehicle is only out of position if it is one vehicle length or farther from the reference line. 3. Questions raised about multiple vehicle violations on red signal phase. Why is only the lead vehicle cited? 4. URS and CAV reported that many events are being canceled by Brekford due to dark shots. 5. DOT-IT reported that there was confusion b/w them and Brekford on the naming conventions of the data files. 6. URS reported that Brekford's processors need to have the Positioning Guides and Site Books to help them do their job. DOT did not report this to Brekford yet. 7. Law and URS reported that some citations show the vehicles speed increasing slightly while the brake lights are on in both images. 8. The first weeks worth of citations (b/w 1000 3000) needed to be voided due to 'Mail By' dates being 20 days after the violation date. 9. Some focus issues with the camera equipment have been consistently reported. 10. Brekford has moved radars around in O t b ith t i tifi ti t th Cit Startup problems reported on 10/4 reason may 1. Brekford resolved the 'Mail By' date issue of have been due to a lack of vehicles passing the +20 days on the evening of 10/10/13. Brekford PCU or an issue with Verizon Wireless took 1 week to provide an explanation in writing Communication. If it was an issue with Verizon it and then just stated that it was due to an IT needs to be addressed as a controllable update. Equipment Malfunction error. Similarly, If RLC 2. 4 RLCs shut down on 10/12 due to marathon. not operational due to BGE poles down than make Brekford turned all back on on 10/13. They it uncontrollable Other if it is due to an handled this well. accident, etc. or Weather Condition if it is due to heavy winds, etc.

1. Due to the issue with Verizon, site 1483 was unable 1. Due to the issue with Verizon, site 6403 was unable to get a test shot and complete end log for 10/22. Per business rules, Brekford is to get a test shot and complete end log for 10/14. Per to have canceled the events as equipment malfunction. business rules, Brekford canceled the events as equipment malfunction. There were 60 events collected from this location. 2. Brekford had noted potential "Radar Effects" as being the cause for some rejected citations. DOT noted that "Radar Effects" are too subjective to be made a rejection code, so all radar related issues should be categorized Equipment Malfunction. 3. DOT has stated that any communications issues with the equipment, even if it's Verizon's issue, need to be documented as a controllable error; most likely "Equipment Malfunction". 4. Brekford has identified a couple of defective radars in October and swapped them out. 5. Hundreds of Red Light citations have different citation #'s in iP360 than what is shown on the printed citations. 6. Brekford has only sent the citation data files to the City on 10/04 and 10/17 in the first 3 weeks of the test run. 7. Law reported that many Red Light citations have a 'Mail By' date of 26 days after the violation date. By law, all Red Light citations must be mailed within 14 days. All will be voided. 8. The reports by Brekford are still incomplete. 2 meetings have been held with Brekford in October. The reports are getting better but not satisfactory yet. 9 Th h b d ti t f 1. Brekford addressed the defective radar unit at Site 6201 on 10/18. 2. Overall, BPD has been able to setup and close down the PCUs this month with only a few problems.

A % of violations will be reviewed by URS in iP360 before There are no erroneous citations. they go to BPD. All printed citations will be reviewed by DOT during Test Run.

No erroneous citations out of the 53 reviewed except as noted for citation 19997493, speed reading looks questionable.

No printed citations to review this week from Brekford.

No printed citations to review this week from Brekford.

No printed citations to review this week from Received printed citations on 08/22/13 for Brekford. citations up to 08/18/13. DOT gave comments the next week.

3 questionable citations found that should not have been issued.

No erroneous citations found by URS for this week.

Phony Trial Requests BRC

Total # of phony trial requests created same as total # trial Not testing per DOT-IT. requests received by DOT and vendor. Dummy files. BRC will determine which citations to make trial requests for. Not testing per DOT-IT. Total # of phony payment, trial and flagging created is same as total # of trial, payment, and flagging data Phony payment, trial and flagging received by DOT and vendor. Dummy files. BRC will make up data to test data transfers. DOT Traffic can retrieve data in OnBase DOT-IT will upload data from vendor to OnBase daily. DOT Not uploaded yet. verifies. Not testing. Payment, trial and flagging data is Automated daily data transfer is occurring between uploaded into iP360 daily Brekford, MOIT and DOT-IT Reports and data accessible in csv Automated daily data transfer is occurring between MOIT Yes. format and DOT-IT Not testing. Monthly report sent to DOT to Automated daily data transfer is occurring between MOIT check invoices, accessible on and DOT-IT Mainframe also.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

DOT is getting ready for the Adjudication Trial run. Not testing per DOT-IT.

DOT is getting ready for the Adjudication Trail Run.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not testing per DOT-IT.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. 3 daily automated transfer files (payment, flagging, court package)setup from City to Brekford but no data in them yet. Yes. Not testing.

Not uploaded yet. 4 daily automated transfer files (payment, flagging, court package)setup from City to Brekford but no data in them yet. Yes. Not testing.

Not uploaded yet. 5 daily automated transfer files (payment, flagging, court package)setup from City to Brekford but no data in them yet. Yes. Not testing.

Not uploaded yet. 5 daily automated transfer files (payment, flagging, court package)setup from City to Brekford but no data in them yet. Yes. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

Not uploaded yet. Not testing.

MOIT/ DOT-IT

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Yes. Not testing.

Other Performance Metrics When We Go Liv


Cases Dismissed Rate Overall and Cases Dismissed by Location/Total Cases on Docket by by Location Location DOT Cases Upheld Rate Overall and by Cases Upheld by Location/Total Cases on Docket by Location Location; gauge court outcomes by location. Cases Dismissed Rate Overall and Cases Dismissed by Reason/Total Cases on Docket by Reason DOT-IT Monthly Reports Generated from Payment Reports, Flagged Vehicles, Trial Requests, Trial Data in System Disposition, Unpaid Citations, Summary Report Total $ Collected from Paid Citations Total # of Delinquent Citations Total Trial Requests by Location Monitor citation status total $ collected from paid citations; separate speed and red light payments. Update monthly for CitiStat. Total value of unpaid citation fines; separate speed and red light. Update monthly for CitiStat. Total and Monthly basis for CitiStat. Total # of paid citations, unpaid (delinquent citations), flagged vehicles, trial requests by location, adjudication outcomes N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run. No reports generated for Test Run.

BRC BRC BRC BRC

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

N/A for Test Run. N/A for Test Run. N/A for Test Run. N/A for Test Run.

Violation Date Total Violations Brekford Processing Brekford Accepted Brekford Cancels Client Processing Client Accepted Client Rejected Print Queue Printed 7/15/2013 102 7 58 37 0 58 0 0 58 7/16/2013 112 7 87 18 0 87 0 0 87 7/17/2013 192 5 136 51 0 134 0 0 134 7/18/2013 199 13 149 37 9 20 9 0 20 7/19/2013 144 2 57 85 4 0 4 0 0 7/22/2013 210 9 166 35 5 0 5 0 0 7/23/2013 180 12 91 77 11 0 11 0 0 7/24/2013 169 11 126 32 80 0 5 0 0 7/25/2013 200 16 142 42 142 0 0 0 0 7/26/2013 168 0 0 168 0 0 0 0 0 7/29/2013 67 2 12 53 12 0 0 0 0 7/30/2013 158 6 74 78 74 0 0 0 0 7/31/2013 114 7 89 18 89 0 0 0 0 8/1/2013 104 46 0 55 0 0 0 0 0

2119

143

1187

786

426

299

34

299

Processing Status

250

200 Client Rejected Violations 150 Print Queue Brekford Processing 100 Brekford Cancels Printed Client Accepted 50 Brekford Accepted 0 7/15/2013 7/16/2013 7/17/2013 7/18/2013 7/19/2013 7/20/2013 7/21/2013 7/22/2013 7/23/2013 7/24/2013 Printed Brekford Processing 7/25/2013 7/26/2013 7/27/2013 7/28/2013 7/29/2013 7/30/2013 Client Rejected 7/31/2013 8/1/2013 Brekford Accepted Total Violations

You might also like